Weekly News header

News That Caught Our Eye #37: November 21, 2024

Published on January 1, 1970

Summary

This Week in AI News: Frank McCourt, speaking at the Rebooting Democracy in the Age of AI Lecture Series, highlighted the dangers of Big Tech's centralized control over personal data and proposed a "New Net" to prioritize user-owned identities and data portability. The National League of Cities, in partnership with Google, released a toolkit to guide local governments in adopting AI responsibly, emphasizing public engagement and tailored policies. The Texas Legislature is set to consider the Responsible AI Governance Act, which would regulate high-risk AI systems and create an AI Regulatory Sandbox Program. The U.S. Department of Homeland Security unveiled a framework for safely deploying AI in critical infrastructure sectors like energy and transportation. Additionally, the U.S. Patent and Trademark Office banned generative AI tools for most tasks, citing concerns over security and bias, while exploring AI's potential for internal testing and patent searches. From local governance to federal oversight, these developments reflect ongoing efforts to balance AI innovation with ethical and secure implementation.

News That Caught Our Eye

News That Caught Our Eye

Frank McCourt on Our Biggest Fight and Future of TikTok

Beth Simone Noveck on November 20, 2024 in Reboot Democracy

The MIT Tech Review profile on biometric company CLEAR highlights the growing concern over surrendering personal data for convenience, a theme echoed by Frank McCourt, founder of Project Liberty and author of Our Biggest Fight. Speaking at the Rebooting Democracy in the Age of AI Lecture Series, McCourt criticized the centralized control of data by tech giants, likening it to a "feudal Internet" where platforms act as modern monarchs. He advocates for a "New Net" with user-owned identities, portable data, and value-driven engagement, using a potential TikTok acquisition to showcase this vision. While his approach emphasizes personal data sovereignty, critics argue that collective governance and democratic institutions are essential for tackling shared digital challenges like misinformation, content moderation, and algorithmic bias. McCourt calls for bipartisan collaboration to ensure technology serves humanity, balancing individual rights with societal needs.

Read article

AI and Public Engagement

AI and Public Engagement

Co-creating the future: participatory cities and digital governance

Dirk Helbing et al on November 13, 2024 in Royal Society Publishing

“The digital revolution, fueled by advancements in social media, Big Data, the Internet of Things and Artificial Intelligence, is reshaping our urban landscapes into ‘participatory cities’. These cities leverage digital technologies to foster citizen engagement, collaborative decision-making and community-driven urban development, thus unlocking new potentials while confronting emerging threats. Such technologies are empowering individuals and organizations in ways that were unimaginable just a few years ago. They do, however, introduce new risks and vulnerabilities that must be carefully managed. Hence, socio-technical innovation is urgently needed. In this connection, open-source technologies, participatory approaches and new forms of governance are becoming more popular and relevant. This theme issue looks into the tangible impacts of these technological advancements, with a focus on participatory cities. It aims to explain how digital tools are used in cities to tackle urban challenges, improve governance and promote sustainability. Through a collection of in-depth analyses, case studies and real-world examples, this issue seeks to offer a comprehensive understanding of the digital governance frameworks underpinning participatory cities. By offering a platform for multidisciplinary discourse, this theme issue endeavors to contribute to the broader narrative of shaping a more resilient, sustainable and democratic urban future in the digital age.”

Read article

AI and Public Engagement

Procedural fairness in algorithmic decision-making: the role of public engagement

Marie Christin Decker on November 15, 2024 in Springer Nature Link

“Despite the widespread use of automated decision-making (ADM) systems, they are often developed without involving the public or those directly affected, leading to concerns about systematic biases that may perpetuate structural injustices. Existing formal fairness approaches primarily focus on statistical outcomes across demographic groups or individual fairness, yet these methods reveal ambiguities and limitations in addressing fairness comprehensively. This paper argues for a holistic approach to algorithmic fairness that integrates procedural fairness, considering both decision-making processes and their outcomes. Procedural fairness emphasizes the importance of fair decision-making procedures, which aligns with theories of relational justice that stress the quality of social relations and power dynamics. We highlight the need for substantive procedural fairness to ensure better outcomes and address forward-looking responsibilities. Additionally, we propose leveraging Public Engagement, a core dimension within the well-established Responsible Research and Innovation framework, to enhance procedural fairness in ADM systems. Our contribution underscores the value of Public Engagement in fostering fairer ADM processes, thereby expanding the current focus beyond technical outcome-based approaches to encompass broader procedural considerations.”

Read article

AI and Public Engagement

Human-AI coevolution

on February 1, 2024 in ScienceDirect

“Human-AI coevolution, defined as a process in which humans and AI algorithms continuously influence each other, increasingly characterizes our society, but is understudied in artificial intelligence and complexity science literature. Recommender systems and assistants play a prominent role in human-AI coevolution, as they permeate many facets of daily life and influence human choices through online platforms. The interaction between users and AI results in a potentially endless feedback loop, wherein users' choices generate data to train AI models, which, in turn, shape subsequent user preferences. This human-AI feedback loop has peculiar characteristics compared to traditional human-machine interaction and gives rise to complex and often “unintended” systemic outcomes. This paper introduces human-AI coevolution as the cornerstone for a new field of study at the intersection between AI and complexity science focused on the theoretical, empirical, and mathematical investigation of the human-AI feedback loop. In doing so, we: (i) outline the pros and cons of existing methodologies and highlight shortcomings and potential ways for capturing feedback loop mechanisms; (ii) propose a reflection at the intersection between complexity science, AI and society; (iii) provide real-world examples for different human-AI ecosystems; and (iv) illustrate challenges to the creation of such a field of study, conceptualizing them at increasing levels of abstraction, i.e., scientific, legal and socio-political.”

Read article

AI for Governance

AI for Governance

AI Report and Toolkit

on November 13, 2024 in NLC 100

Artificial Intelligence is transforming local government by improving city services, supporting staff, and enhancing decision-making. The National League of Cities (NLC) AI Report and Toolkit, developed by a 20-member AI Advisory Committee in 2024, provides practical guidance for local governments on integrating AI responsibly. The report explains various types of AI, explores their applications in city services, and includes principles for ethical use and case studies of successful implementation. The toolkit offers four key tools to help cities assess their AI readiness, develop policies, and engage the public, ensuring responsible and effective use of AI while addressing concerns about bias, privacy, and transparency.

Read article

AI for Governance

The government is working to improve data access. An AI chatbot could be part of that

Madison Alder on November 18, 2024 in FedScoop

The National Science Foundation’s demonstration project, part of the National Secure Data Service (NSDS), aims to enhance U.S. government data infrastructure, including an AI chatbot to simplify access to statistical information. The chatbot, under development with a target completion date of August 2025, could answer user queries about public data, such as STEM graduation rates or flood zones, using natural language processing and providing sources for its responses. The NSDS, mandated by the CHIPS and Science Act, seeks to streamline federal data access, improve research, and protect privacy. Current challenges include complex data linking, legal barriers, and limited accessibility. The initiative involves 30 projects, including secure computing environments, synthetic data generation, and an AI-readiness assessment for federal data. With a planned website launch in 2025 and a minimum viable product by 2027, the NSDS aims to create a seamless, user-friendly data ecosystem, testing its tools through high-impact use cases.

Read article

AI for Governance

To avoid ‘AI divide,’ National League of Cities and Google share AI report and toolkit for local governments

Keely Quinlan on November 14, 2024 in StateScoop

The National League of Cities and Google Public Sector released a report offering guidance and tools for local governments to adopt AI responsibly while avoiding an “AI divide.” The 50-page report evaluates how cities use AI, highlights its risks, and provides case studies, safety practices, and step-by-step questionnaires for AI implementation. While predictive AI has long been used by cities, generative AI is just beginning to gain traction, with 96% of surveyed mayors expressing interest. The toolkit includes readiness assessments, public engagement strategies, and policy development guides, emphasizing the need for tailored approaches and strong safeguards to modernize city services and maximize AI’s economic benefits responsibly.

Read article

AI for Governance

AI policy directions in the new Trump administration

John Villasenor and Joshua Turner on November 15, 2024 in Brookings Institution

The second Trump administration, beginning in 2025, is expected to significantly shape U.S. AI policy. Likely changes include a more hands-off approach to AI regulation, potentially rescinding or modifying Biden-era policies like the AI Executive Order, while focusing on strengthening export controls to limit China’s access to advanced AI technologies. Increased attention to AI’s military applications and a shift away from antitrust enforcement could encourage industry growth but raise competition concerns. Federal efforts may streamline state AI laws through preemption while supporting technologies like autonomous vehicles. With both opportunities and challenges ahead, the administration's policies will play a pivotal role in navigating AI's rapid advancements.

Read article

AI for Governance

Resource Explores Local Government AI Use, Offers Advice

News Staff on November 14, 2024 in Government Technology

The National League of Cities (NLC), in partnership with Google, released the AI in Cities report and toolkit to guide local governments in adopting artificial intelligence responsibly. The report, informed by the NLC AI Advisory Committee, provides foundational knowledge about AI, showcases responsible governance models, highlights use cases like AI-powered chatbots, and examines AI applications abroad. It includes a toolkit with four tools to help cities assess current AI use, evaluate readiness, develop policies, and engage the public. Acknowledging that each community’s needs are unique, the report emphasizes that there is no universal approach to AI adoption and encourages local leaders to tailor AI strategies to their specific challenges and goals.

Read article

AI and Problem Solving

AI and Problem Solving

AI-Ready: An Evaluation Guide for Health and Human Services Agencies

on November 13, 2024 in Center for Public Sector AI

“After months of hard work, collaboration, and valuable feedback from government leaders, we are pleased to release AI Ready: An Evaluation Guide for HHS Agencies. A collaboration between the Center for Public Sector AI, U.S. Digital Response, Humane Intelligence, and the Aspen Institute Financial Security Program, this practical tool is designed to help HHS teams make informed decisions about AI adoption and proactively mitigate potential risks. This guide is the first in a series of best practices, tools, and frameworks we are building to support the safe exploration of AI in HHS service and benefit delivery.”

Read article

AI and Problem Solving

Taking AI experimentation to the next level in cities

on November 15, 2024 in Bloomberg Cities

Generative AI is changing how cities work by expediting processes like procurement, citizen engagement, and service delivery. However, its transformative potential relies on city leaders actively experimenting to understand and expand its capabilities. At a recent City Innovation Studio hosted by Bloomberg Philanthropies, over 90 cities explored AI’s "jagged frontier," the boundary of what the technology can and cannot currently achieve. Leaders used AI to prototype solutions for urban challenges, uncovering its strengths in problem-solving and ideation while recognizing its limitations, such as a lack of regulatory safeguards and gaps in addressing nuanced community needs. Experts emphasize the importance of training AI with localized data, maintaining ethical oversight, and involving residents to ensure responsible adoption. With these strategies, cities can harness AI’s potential while demanding improvements from developers to better serve public needs.

Read article

AI and Problem Solving

AI takes aim at tedious tasks in government contracting

Sandra Erwin on November 14, 2024 in Space News

AI is transforming the traditionally time-intensive government contracting process by streamlining tasks such as identifying opportunities, drafting proposals, and analyzing compliance requirements. Various companies have developed AI-enabled tools that aim to make the procurement process more efficient while aligning with strict government standards. However, challenges remain, including ensuring data security and addressing potential errors. While AI accelerates processes, experts emphasize the critical role of human oversight to maintain quality and compliance, predicting that the adoption of these tools will significantly reshape the government contracting landscape in the coming years.

Read article

Governing AI

Governing AI

The US Patent and Trademark Office Banned Staff From Using Generative AI

on November 19, 2024 in Wired

The US Patent and Trademark Office (USPTO) has banned the use of generative AI tools like ChatGPT for most tasks, citing concerns over security, bias, and unpredictability. While employees cannot rely on such tools for work or use AI-generated outputs, they are allowed to experiment with AI models within the agency's internal testing environment through its AI Lab. The USPTO has also invested $75 million to enhance its patent database with AI-powered search features. This cautious approach reflects broader challenges in integrating AI into government operations, as seen with other agencies like NASA, which limits AI use for sensitive data while experimenting with its potential for coding and data accessibility.

Read article

Governing AI

Effective Remedies in AI: an Insufficiently Explored Avenue for AI Accountability

Laura Lazaro Cabrera on November 14, 2024 in Center for Democracy and Technology

A recent article examines the ongoing challenges of ensuring effective remedies for individuals impacted by AI systems in the European Union. While the European Charter of Fundamental Rights guarantees the right to an effective remedy, the complexity and opacity of AI systems can make it difficult for individuals to understand how they have been affected, complicating legal recourse. The AI Act introduces important transparency measures, such as requiring providers to disclose the use of AI systems in decision-making, particularly for high-risk applications. Though its complaint mechanisms offer a step forward, the article highlights that further efforts, including the AI Liability Directive, are necessary to address procedural barriers and strengthen access to remedies. As AI continues to play a larger role in daily life, the article stresses the need for comprehensive legal frameworks that ensure AI accountability and protect individuals' rights across the EU.

Read article

Governing AI

Groundbreaking Framework for the Safe and Secure Deployment of AI in Critical Infrastructure Unveiled by Department of Homeland Security

on November 14, 2024 in Department of Homeland Security

The U.S. Department of Homeland Security (DHS) has released the Roles and Responsibilities Framework for Artificial Intelligence in Critical Infrastructure. Developed by the DHS Artificial Intelligence Safety and Security Board, the framework offers guidelines for safely deploying AI across key sectors like energy, water, and transportation. It outlines recommendations for stakeholders, including AI developers, cloud providers, and infrastructure operators, to address risks such as cyberattacks, design flaws, and misuse. The voluntary framework aims to enhance AI security and collaboration across public and private sectors, promoting responsible AI integration without imposing regulatory requirements.

Read article

Governing AI

California lawmakers target AI-fueled fraud in new House bill

Matt Bricken on November 15, 2024 in FedScoop

A bipartisan pair of House lawmakers is introducing legislation to address the growing threat of AI-driven fraud. The "AI Fraud Deterrence Act," introduced by California Reps. Ted Lieu (D) and Kevin Kiley (R), aims to impose harsher penalties on individuals who use artificial intelligence to commit wire fraud, mail fraud, bank fraud, or money laundering. The bill specifically targets AI’s role in enhancing fraudulent activities, proposing to raise fines for AI-related bank fraud from $1 million to $2 million, and for AI-assisted money laundering from $500,000 to $1 million, or up to three times the value of the property involved. Penalties for wire and mail fraud would also increase from $250,000 to $1 million if AI tools are used to perpetrate the crime. In cases where fraud involves disaster aid or financial institutions, the bill would double existing penalties to $2 million, irrespective of AI involvement. The lawmakers argue that by increasing penalties for AI-fueled fraud, the bill seeks to curb the misuse of rapidly advancing AI technologies, ensuring they are used responsibly while protecting individuals and institutions from emerging threats.

Read article

Governing AI

Texas Legislature to Consider Sweeping AI Legislation in 2025

Matthew Shapanka, Jayne Ponder and August Gweon on November 13, 2024 in Covington

Texas Representative Giovanni Capriglione has introduced a draft of the Texas Responsible AI Governance Act (TRAIGA), aiming to regulate "high-risk AI systems" with a focus on consumer protection and risk management. Modeled after Colorado's AI Act and the EU AI Act, TRAIGA includes stricter thresholds for defining high-risk systems, bans on AI systems with "unacceptable risks," and requirements for distributors to prevent algorithmic discrimination. Unique provisions include mandatory record-keeping for generative AI developers, expanded reporting obligations for deployers, and exemptions for small businesses, research, and open-source developers. TRAIGA would also create an AI Regulatory Sandbox Program, a workforce grant initiative, and an advisory AI Council, while authorizing enforcement by the Texas Attorney General. If passed, TRAIGA could serve as a national model for risk-based AI regulation, though it faces potential amendments and uncertain prospects in the upcoming 2025 legislative session.

Read article

AI and International Relations

AI and International Relations

What is ‘sovereign AI’ and why is the concept so appealing (and fraught)?

on November 13, 2024 in World Economic Forum

Countries are increasingly developing sovereign AI initiatives to protect their cultural identity, bolster economic competitiveness, and reduce reliance on foreign technologies. Denmark, for instance, has funded a supercomputer with revenues from weight-loss drugs to support AI-driven biotech and pharmaceutical research, while Italy, Sweden, the UAE, and India are pursuing similar projects. Sovereign AI enables nations to embed their values and priorities into technology but poses risks of "sovereignty traps" that could hinder global cooperation. High costs, geopolitical tensions over chip access, and the challenge of aligning national and global interests complicate efforts. Advocates suggest cross-border collaboration, like a Global AI Compact, to ensure equitable access to AI infrastructure, likening its importance to electricity in the modern world. However, nations must navigate tensions between codifying cultural identity and fostering inclusive global AI governance.

Read article

AI and International Relations

A US Ban on Investing in Chinese AI Startups Could Escalate Under Trump

Zeyi Yang on November 18, 2024 in Wired

The US Treasury Department has finalized new restrictions, effective January 2025, limiting American investments in advanced Chinese AI startups for national security reasons. These rules ban funding for AI technologies tied to China's military or intelligence services and impose a threshold of 1025 flops (a measure of AI model power) to restrict investments in cutting-edge consumer AI. The move, part of broader efforts like export controls and investment scrutiny, aims to slow China's AI advancements while reinforcing US dominance. Although current impacts are modest, the regulations add due diligence burdens for US investors and could discourage Chinese startups from seeking US support. The incoming Trump administration may expand these measures further, with Republican China hawks advocating tougher restrictions on other sectors like biotech and batteries.

Read article

AI and International Relations

US government commission pushes Manhattan Project-style AI initiative

Anna Tong and Michael Martina on November 19, 2024 in Reuters

The U.S.-China Economic and Security Review Commission (USCC) has proposed a Manhattan Project-style initiative to develop artificial general intelligence (AGI) to compete with China's advancements in AI. Highlighting the importance of public-private partnerships, the report emphasizes the need for strategic government involvement without detailing specific investment strategies. Commissioner Jacob Helberg noted that addressing energy infrastructure bottlenecks, such as streamlining permits for data centers, could accelerate AI progress. In addition to AI, the USCC's annual report recommends tightening trade regulations, including ending the de minimis trade exemption, which allows duty-free entry for low-value Chinese goods, and imposing stricter controls on Chinese involvement in U.S. biotechnology. However, implementing these recommendations faces challenges, such as bipartisan disagreements and resistance from the shipping industry and trade groups concerned about e-commerce disruption.

Read article

AI and International Relations

War and Peace in the Age of Artificial Intelligence

Henry A. Kissinger, Eric Schmidt, and Craig Mundie on November 18, 2024 in Foreign Affairs

AI is poised to reshape warfare, diplomacy, and global power dynamics, offering precision and speed but raising ethical and existential concerns. It could escalate conflicts by targeting digital infrastructure, fueling secrecy and paranoia among nations racing for dominance, or disrupting traditional nation-state authority as corporations and decentralized groups gain influence. While AI’s objectivity might enable better governance and conflict resolution, its lack of human restraint risks spiraling into destructive scenarios. The challenge lies in balancing AI’s potential to solve complex problems with preserving human agency and avoiding over-reliance on technology that could destabilize global order.

Read article
▲