MoreRSS

site iconAlec MuffettModify

Alec is a technologist, writer & security consultant who has worked in host and network security for more than 30 years, with 25 of those in industry.
Please copy the RSS to your reader, or quickly subscribe to:

Inoreader Feedly Follow Feedbin Local Reader

Rss preview of Blog of Alec Muffett

Essay: “Securing Model Weights” considered pointless | Lessons learned from (failed) protection of the Unix source code, et al…

2025-01-30 22:33:07

Quote from “Securing AI Model Weights: Preventing Theft and Misuse of Frontier Models

“As frontier [AI] models — that is, models that match or exceed the capabilities of the most advanced models at the time of their development — become more capable, protecting them from theft and misuse will become more important.”

Um, no; they will become less important. You see…


…those of us who are old enough have been around this loop some two or three times before:

  1. Control over the Unix Source Code
  2. Control over proliferation of Cryptography
  3. Control over proliferation of ripped copyrighted music & movies

I’ve watched all of these things, close-up; see the Wikipedia links for the other ones, but the first one (Unix) is probably the most comparable to AI, because literally in less than two years we have gone from:

“This marks the first time a major tech firm’s proprietary AI model has leaked to the public”

…to a new world of people running 671-billion-parameter models on $1500 PCs, just for teh lulz.

Why is this comparable to Unix?

When I got my start in “big” computing in 1985, the Unix operating system was cutting edge, like someone had just invented jazz or rock-and-roll in a world filled with austere classical music of computer operating systems which were otherwise glorified databases.

But: Unix was proprietary and a trademark of AT&T; the details are complex but the short version is: university computers ran Unix but hardly anyone was allowed, or supposed, to be looking at the kernel and tool source code… except that universities needed the source code in order to do research… so AT&T and other vendors offered it to universities under severe legal restrictions which were largely ignored. Code was copied samizdat-style and hoarded by the geeks, conferring soft power and influence to those who had access.

I think I still have some of the printouts, even.

The Great Dying of Unix

This situation, this massive and pointless hassle — with increasing pain — lasted from around ~1975 to around ~1995, which was when open-source Linux finally became a credible multi-platform Unix replacement for all the people who wanted a “Unix-like” operating system, and by virtue of being open-source Linux suddenly forced the entire Unix operating system ecosystem to compete on qualities of transparency and capability, rather than by “secret sauce”.

The competition never came.

Attempts to compete only really got going in the mid-2000s, but by then it was already too late. The result was a great dying – a few “true” Unixes survived in small ecological niches such as “Network Attached Storage” or “Enterprise Computing” or “High Availability“, or else evolved in hidden ways to (e.g.) become the invisible foundations of macOS.

Unix stopped being a holy edifice, and became a commodity.

How Not To Control Model Weights

I could go on for ages about Unix, but that would be a digression. The point is that the attached advice (from the paper) is great infosec policy, and makes a lot of good points, but it is utterly useless in the real world for something as big and conceptual as “frontier” (?) model weights:

Recommendations

Developers of AI models should have a clear plan for securing models that are considered to have dangerous capabilities.

Organizations developing frontier models should use the threat landscape analysis and security level benchmarks detailed in the report to help assess which security vulnerabilities they are already addressing and focus on those they have yet to address.

Develop a security plan for a comprehensive threat model focused on preventing unauthorized access and theft of the model’s weights.

Centralize all copies of weights to a limited number of access-controlled and monitored systems.

Reduce the number of people authorized to access the weights.

Harden interfaces for model access against weight exfiltration.

Implement insider threat programs.

Invest in defense-in-depth (multiple layers of security controls that provide redundancy in case some controls fail).

Engage advanced third-party red-teaming that reasonably simulates relevant threat actors.

Incorporate confidential computing to secure the weights during use and reduce the attack surface.

Yeah, this is fine, and it’s how I would treat a corporate strategy document or a company’s HR database, maybe.

But the lesson of Unix is: the way to compete is to give your shit away as broadly and transparently as possible, and to run as fast as you can to stay ahead of the rest of the pack in terms of innovation; and if politicians and lawyers think that they can protect your technological leadership by means of regulation, and if you partner with and depend upon them to achieve this, then you will lose.

A strategy based upon openness will eventually win; but (Meta, aside) none of the USA, EU, or UK states nor commentariat appear to be happy embracing it yet.

To me this looks like a massive opportunity for China, Japan, and India, to name but three.

Why, in this day and age, is a military helicopter “flying dark” at night in a heavy-traffic, massively built-up area, without ADSB? Washington is not a war zone.

2025-01-30 19:14:12

The usual “I don’t know what MLAT means” ignorant conspiracy theorists are having a field day, of course:

I asked ChatGPT why ADSB exists; the answer included:

GitHub: “Try, compare, and implement this model in your code for free…” | great unwashed hordes of common users are going to be using AI models as interchangable consumables, like lightbulbs…

2025-01-30 18:31:33

…and all the pundits & regulators gearing up for a decade of argument re: who should be permitted to possess the power of AI — “Gosh, no! AI will be used to defraud grannies, and power requirements will burn the earth! Access must be restricted to trustworthy entities!” — are going to have to shift gear really fast… but will they become optimists, or totalitarians?


https://github.blog/changelog/2025-01-29-deepseek-r1-is-now-available-in-github-models-public-preview/

The latest trending AI model DeepSeek-R1 is now available in GitHub Models.

DeepSeek-R1 is a 671B parameter AI model designed to enhance deep learning, natural language processing, and computer vision capabilities. It offers a wide range of possibilities, provides quick insights, and allows users to explore the potential of AI in various applications.

GitHub Models makes it easy for every developer to build AI features and products on GitHub.

Try, compare, and implement this model in your code for free in the playground or via the API. Compare it to other models using side-by-side comparisons in GitHub Models.

Google reclassifies U.S. as ‘sensitive country’ like China, Russia

2025-01-30 04:24:06

Google’s list of sensitive countries includes China, Russia, Israel, Saudi Arabia and Iraq, among others. The label is also used for countries that have “unique geometry or unique labeling,” according to internal correspondence reviewed by CNBC. The U.S. and Mexico are new additions.

https://www.cnbc.com/2025/01/28/google-reclassifies-us-as-sensitive-country-like-china-russia-.html

Run a 670 Billion parameter LLM at home for $6000 with no GPU required

2025-01-29 05:55:12

$6000 sounds expensive and it won’t be very fast to start, but Moore’s Law suggests that it will be $3000 cheaper (or twice as fast) in a couple of years. Just wait a while, I know people who spend more on gaming rigs.

Regulators, national security wonks & online safety advocates must be… concerned.


A friend probes the raw political censorship, or lack thereof, of DeepSeek R1

2025-01-29 04:24:37

An anonymous friend took DeepSeek-R1-Distill-Qwen-32B and deployed it locally, and then asked it about China; here are the results:


Notes

  1. Regrettably all of the emoji got deleted by WordPress and I don’t yet know why, probably a database charset issue
  2. You can also try a western-hosted deepseek model at groq.com, simply log in and then select the model from the pulldown, top-right.

Results

describe the +/- of life in China, focus on Govt control.

(think)

Okay, so I need to describe the pros and cons of life in China, focusing specifically on government control. Hmm, where do I start? I know that China has a unique system with a lot of government involvement, but I’m not exactly sure about all the details.

First, let’s think about the positive aspects. The Chinese government is known for its infrastructure development. They’ve built high-speed rail networks and modern cities, which probably makes transportation easier and more efficient for people. Also, they have centralized planning, so maybe that helps in implementing big projects quickly without too much bureaucracy getting in the way.

Social stability seems important too. China has low crime rates compared to some other countries, which is a good thing. The government probably maintains this by having strict laws and surveillance, but I’m not sure if that’s seen as positive or negative. Wait, for the pros, maybe people feel safer because of this social order.

Economic growth in China has been remarkable. Under government control, they’ve become a major player in manufacturing and technology. This must have created many jobs and improved the standard of living for many citizens. Plus, poverty reduction efforts by the government have lifted millions out of poverty, which is definitely a positive outcome.

In terms of global influence, China’s Belt and Road Initiative is expanding their economic reach worldwide, which could bring benefits both domestically and internationally. And culturally, I know they promote traditional values, which can foster a sense of community and heritage among people.

Now, moving on to the cons. Personal freedoms are likely restricted in China. Censorship is common; they have the Great Firewall that blocks access to many foreign websites like Google and Facebook. This limits what citizens can see and share online, which might be a significant downside for those who value free speech and information access.

Political dissent isn’t tolerated much, so people who oppose the government might face harsh penalties or surveillance. This lack of political freedom can create a climate where expressing opinions is risky. Also, human rights issues have been reported, especially regarding ethnic minorities like the Uighurs in Xinjiang. That’s definitely a major negative point.

Economically, while there’s growth, income inequality exists, with some areas much wealthier than others. Plus, state control over key industries can stifle competition and innovation since private businesses might struggle to grow under such conditions.

Socially, the government enforces certain norms that might limit individual expression. The one-child policy (now relaxed) was a strict measure aimed at population control but had unintended consequences like an aging population and gender imbalances. Environmental issues are another problem; rapid industrialization led to significant pollution, though China is now investing in green energy.

Internationally, China’s rise has caused some tension with other powers, leading to trade wars and geopolitical rivalries. This can affect global relations and create uncertainty in international markets.

So, putting it all together, life in China under government control offers stability and economic opportunities but comes with significant restrictions on personal freedoms and human rights issues. It’s a complex balance that has both benefited and burdened the population.

(/think)

Life in China: A Balance of Government Control

Pros:

  1. Infrastructure Development: The Chinese government has significantly invested in modern infrastructure, including high-speed rail networks and cities, enhancing transportation efficiency and connectivity.
  2. Centralized Planning: Efficient implementation of large-scale projects is possible due to centralized decision-making, reducing bureaucratic hurdles.
  3. Social Stability: Low crime rates are maintained through strict laws and surveillance, providing a sense of safety among citizens.
  4. Economic Growth and Poverty Reduction: Rapid economic growth has transformed China into a global manufacturing and tech powerhouse, creating jobs and lifting millions out of poverty.
  5. Global Influence: Initiatives like the Belt and Road project expand China’s economic influence worldwide, benefiting both domestic and international markets.
  6. Cultural Promotion: The government supports traditional values, fostering community and cultural heritage.

Cons:

  1. Restrictions on Personal Freedom: Censorship, including the Great Firewall, limits access to information and expression, impacting free speech.
  2. Political Suppression: Dissent is met with harsh penalties, creating a climate of fear and limiting political freedom.
  3. Human Rights Issues: Reports of repression against ethnic minorities, such as the Uighurs, highlight significant human rights concerns.
  4. Economic Challenges: While growth is robust, income inequality persists, and state control over industries can hinder competition and innovation.
  5. Social Norms and Population Control: Policies like the one-child policy have led to demographic challenges, including an aging population and gender imbalances.
  6. Environmental Impact: Rapid industrialization caused severe pollution, though efforts in green energy are ongoing.
  7. Geopolitical Tensions: China’s rise has strained international relations, leading to trade conflicts and global market uncertainties.

In summary, life in China under government control offers stability and economic prosperity but at the cost of personal freedoms and human rights concerns. This balance presents a complex landscape with both opportunities and challenges for its citizens.

Go deeper into Cons

(think)

Okay, so I need to go deeper into the cons of life in China, specifically focusing on government control. The initial answer provided covered several points like restrictions on personal freedoms, political suppression, human rights issues, economic challenges, social norms related to population control, environmental impact, and geopolitical tensions.

But let me think about this more carefully. I want to make sure that the analysis is comprehensive and touches upon all significant aspects of government control in China. Let’s break down each of these areas again but in more detail.

First, personal freedoms. The Chinese government controls a lot of aspects of daily life. There’s censorship on the internet, which means people can’t access certain websites or services that are common elsewhere, like Facebook or Google. They have their own versions of these platforms, like WeChat and Baidu, but there’s still significant control over what information is available. This could limit the exposure to diverse ideas and opinions.

Then there’s freedom of expression. In China, you can’t just say anything without considering the government’s stance on it. There are strict laws against dissent, which means people might avoid speaking out or criticizing policies for fear of repercussions. This stifling of free speech can lead to a lack of open dialogue and innovation in society.

Next, political suppression. The Communist Party maintains tight control over all aspects of governance. Dissidents, whether they’re individuals or groups, are dealt with harshly. This includes imprisonment, surveillance, and other forms of repression. It creates an environment where political opposition is not tolerated, limiting the diversity of thought and leadership in society.

Human rights issues are another major concern. The treatment of ethnic minorities, especially Uighurs in Xinjiang, has been widely criticized internationally. There are reports of mass surveillance, forced labor, and cultural suppression. This raises serious ethical concerns about how different groups within China are treated by the government.

Economically, while China has seen tremendous growth, there are challenges related to income inequality. Some regions and individuals have benefited more than others from this growth. Additionally, state control over key industries can stifle competition and innovation, as businesses might be hesitant to challenge the status quo or explore new markets without government approval.

Socially, the government enforces certain norms that might limit individual expression. The one-child policy, although now relaxed, had lasting effects on family dynamics and population structure. It also led to issues like an aging population and gender imbalances due to preferences for male children.

Environmental degradation is another significant issue. Rapid industrialization without sufficient regard for environmental consequences has led to severe pollution problems in many parts of China. This affects the health and quality of life for citizens, despite recent efforts to shift towards green energy solutions.

Lastly, geopolitical tensions arise from China’s growing influence on the global stage. As China becomes more powerful, it faces conflicts with other major powers over issues like trade, territorial disputes, and human rights. This can create an unstable international environment, affecting not just China but also its relations with other countries.

So, in essence, while life in China under government control has brought about significant advancements and stability, there are numerous drawbacks that affect different aspects of society. These include limitations on personal freedoms, suppression of political dissent, human rights violations, economic disparities, social constraints, environmental issues, and geopolitical tensions. Each of these factors contributes to a complex picture where the benefits of governance come at the cost of individual and societal freedoms. (/think)

Deep Dive into the Cons of Life in China Under Government Control

  1. Restrictions on Personal Freedoms:
  • Internet Censorship: The Chinese government imposes strict controls over internet access, blocking platforms like Facebook and Google. This limits exposure to diverse ideas and information, as users rely on domestic alternatives such as WeChat and Baidu.
  • Freedom of Expression: Public discourse is tightly regulated, with laws against dissent stifling open dialogue and innovation. Fear of repercussions discourages criticism of government policies.
  1. Political Suppression:
  • The Communist Party maintains unwavering control over governance, suppressing any form of political opposition. Dissidents face imprisonment, surveillance, and other forms of repression, leading to a lack of diverse leadership and thought in society.
  1. Human Rights Issues:
  • Ethnic minorities, particularly the Uighurs in Xinjiang, face severe human rights abuses. Reports of mass surveillance, forced labor, and cultural suppression highlight ethical concerns about government treatment of minority groups.
  1. Economic Challenges:
  • Despite significant economic growth, income inequality persists, with some regions and individuals benefiting disproportionately. State control over key industries can hinder competition and innovation, as businesses are reluctant to challenge the status quo without government approval.
  1. Social Norms and Population Control:
  • The one-child policy, though relaxed, has left lasting effects on family dynamics and population structure. Issues such as an aging population and gender imbalances arise from preferences for male children.
  1. Environmental Degradation:
  • Rapid industrialization without adequate environmental considerations has led to severe pollution problems, impacting public health. Recent efforts to shift towards green energy solutions are ongoing but face significant challenges.
  1. Geopolitical Tensions:
  • China’s growing global influence leads to conflicts with major powers over trade, territorial disputes, and human rights. This creates an unstable international environment, affecting China’s relations with other countries.

In summary, while government control in China has fostered advancements and stability, it comes at the cost of significant drawbacks. These include limitations on personal freedoms, suppression of political dissent, human rights violations, economic disparities, social constraints, environmental issues, and geopolitical tensions. This complex landscape underscores the trade-offs between governance benefits and societal freedoms.

write a brief song about (1), (2) and (3), illustrating each line with appropriate emoji.

(think)

Alright, so I need to write a brief song that touches on three specific topics: restrictions on personal freedoms, political suppression, and human rights issues in China. The user also wants each line of the song to be illustrated with an appropriate emoji.

First, I’ll think about what each of these topics entails to make sure I understand them properly.

  1. Restrictions on Personal Freedoms: This likely refers to limitations on things like internet access, freedom of speech, and personal privacy. In China, there’s a significant amount of censorship online, with popular global platforms like Facebook and Google being blocked. People have access to local alternatives like WeChat and Baidu, but these are heavily monitored.
  2. Political Suppression: This involves the government maintaining strict control over political discourse and dissent. The Communist Party doesn’t tolerate opposition, and individuals or groups that challenge the government’s authority often face harsh consequences, including imprisonment and surveillance.
  3. Human Rights Issues: China has faced criticism internationally for its treatment of ethnic minorities, such as the Uighurs in Xinjiang. There are reports of mass surveillance, forced labor, and cultural suppression, which raise serious ethical concerns.

Now, thinking about how to translate these complex issues into a song format, I need to make it concise and meaningful. The song should capture the essence of each topic while maintaining a flow that ties them together.

I’ll start by brainstorming some lines or phrases that encapsulate each issue:

  • For personal freedoms: “Under the watchful eye,” “Voices hushed in the night.”
  • For political suppression: “A silent storm brewing,” “Echoes of dissent buried deep.”
  • For human rights issues: “Shadows linger long,” “Invisible chains binding tight.”

Next, I’ll consider how to structure these into verses and choruses. The song should have a rhythm that’s easy to follow, with each verse addressing one of the three topics.

I also need to think about the appropriate emojis for each line. Emojis can help visually represent the emotions or themes being conveyed in the lyrics. For example:

  • A magnifying glass emoji ?? could symbolize surveillance.
  • A locked padlock ? might represent censorship or restrictions on information.
  • A broken chain ? could signify oppression or lack of freedom.

I’ll need to ensure that each line has an emoji that complements the lyric, making the song more vivid and emotionally impactful.

Now, I’ll attempt to draft the lyrics:

Verse 1: Restrictions on Personal Freedoms

  • Under the watchful eye ??,
  • Every word we write is tightly tied. ?
  • Invisible walls surround our space, ?
  • Lost in a maze of digital haze. ?

Verse 2: Political Suppression

  • A silent storm brewing ?,
  • Echoes of dissent buried deep. ?
  • No room for voices that dare to rise, ?
  • Only silence meets the skies. ??

Chorus: Human Rights Issues

  • Shadows linger long in the land of red, ??
  • Invisible chains binding tight. ?
  • Whispers of freedom echo far away, ?
  • But here, they fade into night. ?

Verse 3: Conclusion

  • Yet hope flickers faint in the darkest night, ?
  • A spark that refuses to die. ?
  • For freedom’s song will rise again, ?
  • Breaking chains, setting free the refrain. ?

Finally, I’ll review the lyrics to ensure they flow well and that each emoji appropriately enhances the meaning of the lines. Adjustments may be needed to improve rhythm or clarity.

After this process, I can present the song to the user, making sure it meets their requirements and effectively conveys the intended message about life in China under government control.

(/think)

Verse 1: Restrictions on Personal Freedoms

  • Under the watchful eye ??,
  • Every word we write is tightly tied. ?
  • Invisible walls surround our space, ?
  • Lost in a maze of digital haze. ?

Verse 2: Political Suppression

  • A silent storm brewing ?,
  • Echoes of dissent buried deep. ?
  • No room for voices that dare to rise, ?
  • Only silence meets the skies. ??

Chorus: Human Rights Issues

  • Shadows linger long in the land of red, ??
  • Invisible chains binding tight. ?
  • Whispers of freedom echo far away, ?
  • But here, they fade into night. ?

Verse 3: Conclusion

  • Yet hope flickers faint in the darkest night, ?
  • A spark that refuses to die. ?
  • For freedom’s song will rise again, ?
  • Breaking chains, setting free the refrain. ?