This Week's Sponsor:

Setapp

Start Your 30-day Free Trial Today

Posts tagged with "Apple Silicon"

Quick Subtitles Shows Off the A19 Pro’s Remarkable Transcription Speed→

Matt Birchler makes a great utility for the iPhone and iPad called Quick Subtitles that generates transcripts from a wide variety of audio and video files, something I do a lot. Sometimes it’s for adding subtitles to a podcast’s YouTube video and other times, I just want to recall a bit of information from a long video without scrubbing through it. In either case, I want the process to be fast.

As Matt prepared Quick Subtitles for release, he tested it on a MacBook Pro with an M4 Pro chip, an iPhone 17 Pro with the new A19 Pro, an iPhone 16 Pro Max with the A18 Pro, and an iPhone 16e with the A18. The results were remarkable, with the iPhone 17 Pro nearly matching the performance of Matt’s M4 Pro MacBook Pro and 60% faster than the A18 Pro.

I got a preview of this sort of performance over the summer when I ran an episode of NPC: Next Portable Console through Yap, an open-source project my son Finn built to test Apple’s Speech framework, which Quick Subtitles also uses. The difference is that with the release of the speedy A19 Pro, the kind of performance I was seeing in June on a MacBook Pro is essentially now possible on an iPhone, meaning you don’t have to sacrifice speed to do this sort of task if all you have with you is an iPhone 17 Pro, which I love.

If you produce podcasts or video, or simply want transcripts that you can analyze with AI, check out Quick Subtitles. In addition to generating timestamped SRT files ready for YouTube and other video projects, the app can batch-transcribe files, and use a Google Gemini or OpenAI API key that you supply to analyze the transcripts it generates. Transcription happens on-device and your API keys don’t leave your device either, which makes it more private than transcription apps that rely on cloud servers.

Quick Subtitles is available on the App Store as a free download and comes with 10 free transcriptions. A one-time In-App Purchase of $19.99 unlocks unlimited transcription and batch processing. The In-App Purchase is currently stuck in app review, but should be available soon, when I’ll be grabbing it immediately.

Permalink

The M3 Ultra Mac Studio for Local LLMs→

Speaking of the new Mac Studio and Apple making the best computers for AI: this is a terrific overview by Max Weinbach about the new M3 Ultra chip and its real-world performance with various on-device LLMs:

The Mac I’ve been using for the past few days is the Mac Studio with M3 Ultra SoC, 32-core CPU, 80-core GPU, 256GB Unified Memory (192GB usable for VRAM), and 4TB SSD. It’s the fastest computer I have. It is faster in my workflows for even AI than my gaming PC (which will be used for comparisons below; it has an Intel i9 13900K, RTX 5090, 64GB of DDR5, and a 2TB NVMe SSD).

It’s a very technical read, but the comparison between the M3 Ultra and a vanilla (non-optimized) RTX 5090 is mind-blogging to me. According to Weinbach, it all comes down to Apple’s MLX framework:

I’ll keep it brief; the LLM performance is essentially as good as you’ll get for the majority of models. You’ll be able to run better models faster with larger context windows on a Mac Studio or any Mac with Unified Memory than essentially any PC on the market. This is simply the inherent benefit of not only Apple Silicon but Apple’s MLX framework (the reason we can efficiently run the models without preloading KV Cache into memory, as well as generate tokens faster as context windows grow).

In case you’re not familiar, MLX is Apple’s open-source framework that – I’m simplifying – optimizes training and serving models on Apple Silicon’s unified memory architecture. It is a wonderful project with over 1,600 community models available for download.

As Weinbach concludes:

I see one of the best combos any developer can do as: M3 Ultra Mac Studio with an Nvidia 8xH100 rented rack. Hopper and Blackwell are outstanding for servers, M3 Ultra is outstanding for your desk. Different machines for a different use, while it’s fun to compare these for sport, that’s not the reality.⁠⁠

There really is no competition for an AI workstation today. The reality is, the only option is a Mac Studio.

Don’t miss the benchmarks in the story.

Permalink

Developers Demonstrate AAA Windows Gaming on M1 and M2 Macs Using Linux→

Yesterday, developer Alyssa Rosenzweig gave a talk at the XDC conference in Montréal, Canada about gaming on Asahi Linux installed on M1 and M2 Apple silicon-based Macs. According to GamingOnLinux:

They announced their “Asahi game playing toolkit” which brings together their Vulkan 1.3 graphics driver with, and x86 emulation with Windows game compatibility. It’s all still “Alpha” level quality, but good enough to run some AAA games now. Unlike Apple’s own macOS, Asahi Linux has the only conformant OpenGL®, OpenCL™, and Vulkan® drivers for this hardware (as Apple focus on their own API - Metal).

With Asahi Linux installed on your Mac and at least 16GB of memory to handle emulation overhead, Rosenzweig explained that demanding games like Control, Fallout 4, and Cyberpunk 2077 are all playable. That said, it’s still early days for the Ashahi game-playing toolkit, with more work to be done to support more modern AAA Windows games running at 60fps.

Still, what Rosenzweig and other contributors to the project have achieved is impressive, with more details available on Rosenzweig’s website. It’s also heartening to see developers coming up with solutions that work with commonly-used Windows graphics APIs instead of waiting for game developers to adopt Apple’s Metal framework.

Permalink

The M3’s Potential to Transform Mac Gaming→

Raymond Wong has an excellent story on Inverse about the Mac and gaming. Wong spoke to multiple Apple representatives about its push to build Macs that can handle the most demanding PC and console games, exploring the impact of Apple silicon on the company’s efforts. In that vein, Doug Brooks, a member of the Mac product marketing team, told Inverse:

Gaming was fundamentally part of the Apple silicon design. Before a chip even exists, gaming is fundamentally incorporated during those early planning stages and then throughout development. I think, big picture, when we design our chips, we really look at building balanced systems that provide great CPU, GPU, and memory performance. Of course, [games] need powerful GPUs, but they need all of those features, and our chips are designed to deliver on that goal. If you look at the chips that go in the latest consoles, they look a lot like that with integrated CPU, GPU, and memory.

That integrated, console-like approach has the added benefit of bringing the iPhone and iPad along for the ride, greatly expanding the potential size of the market for game developers. According to Leland Martin, one of Apple’s software marketing managers:

If you look at the Mac lineup just a few years ago, there was a mix of both integrated and discrete GPUs. That can add complexity when you’re developing games. Because you have multiple different hardware permutations to consider. Today, we’ve effectively eliminated that completely with Apple silicon, creating a unified gaming platform now across iPhone, iPad, and Mac. Once a game is designed for one platform, it’s a straightforward process to bring it to the other two. We’re seeing this play out with games like Resident Evil Village that launched first [on Mac] followed by iPhone and iPad.

With the introduction of the M3 family of chips, Apple’s gaming story continues to evolve by adding hardware-accelerated ray tracing, mesh shaders, and Dynamic Caching, which determines on-the-fly the amount of memory to make available to the M3’s GPU for improved performance. Those chip enhancements are paired with new developer tools designed to make it easier to bring games to the Mac.

There are a lot of variables at play, and whether Apple can compete head-to-head with PC and console games is far from certain. However, what’s clear is that Apple is doing more than at any time in recent memory to make a run at the top end of the videogame market.

Some of the fruits of those efforts are beginning to appear on the App Store. Capcom’s Resident Evil Village debuted on the Mac in the fall of 2022 and more recently on the iPhone and iPad. As Wong notes, Lies of P, one of the top releases of the year was released on the Mac at the same time as other platforms, and Baldur’s Gate 3 was released on Steam for the Mac just a couple of months after its debut on other platforms. Plus, Capcom is back with Resident Evil 4 on every Apple device, and Death Stranding is slated for early next year. That’s a lot of top-notch games.

I’ve been playing many of these titles across an original M1 MacBook Air, M1 Max Mac Studio, and, most recently, on M3 Max MacBook Pro that Apple sent me, and the early results aren’t surprising. The M1 MacBook Air struggles, while the M3 Max MacBook Pro looks stunning. That may not make any Mac the best choice for gaming today, but with the M3, the technology to make it competitive with PCs and consoles is emerging and will inevitably trickle down to more affordable Macs over time.

Whether that happens fast enough and whether Apple can attract the biggest games are just two of many open questions. However, as we head into 2024, I’m encouraged by what I’ve seen so far and plan to share more of my ongoing exploration of Mac gaming in the new year.

Permalink

First Look: Stray for Mac

Source: Annapurna Interactive.

Source: Annapurna Interactive.

Stray, a high-profile and well-regarded videogame that debuted in 2022, is now available on the Mac. Initially launched on PlayStation and Windows, followed by an Xbox version this past August, today’s Mac release is available on both the Mac App Store and Steam.

The game, created by BlueTwelve Studio and published by Annapurna Interactive, is set in a neon-lit, post-apocalyptic cityscape where you play as a cat. Thrown into an unfamiliar environment, your goal is to solve the mysteries of a dangerous rundown city aided by a flying robot named B-12.

Stray was generally well-received by reviewers, who appreciated how BlueTwelve imbued its cat protagonist with personality and captured life-like cat movement and behavior. As a result, it’s unsurprising that the number of systems on which you can enjoy Stray’s feline adventures has continued to expand.

I played Stray when it debuted on the PlayStation 5 and enjoyed it. The game’s controls are relatively simple, and the story isn’t terribly long, but the puzzles are challenging, and the cyberpunk visuals are stunning. It’s been a while since I last dipped into Stray, but the game was one of my favorites of 2022, so when I got the chance to play it a day before the launch, I jumped at the opportunity.

I’ve only had time to play Stray on the Mac for a few hours, navigating through the introductory scene and the early part of the game, so this isn’t a review. However, as someone familiar with the console version, I thought I’d share my early impressions playing on my M1 Max Mac Studio and my M1 MacBook Air.

Read more

Apple Introduces the New MacBook Pro in Three M3 Chip Configurations

Source: Apple.

Source: Apple.

One of the things I’ve enjoyed about the rollout of Apple silicon Macs is that the old rules don’t apply, and the new ones are still being written. The cadence of releases is still settling in, and today, in the face of speculation that Apple was struggling to release M3 Macs, Apple made it clear that not one, but three 3 nanometer process-based chips are ready to ship. Along with the M3 iMac, the company refreshed its entire lineup of MacBook Pros, computers that gained the M2 chip less than a year ago.

Read more

Apple Reveals New M3 iMac

The new iMac.

The new iMac.

Just over two years ago, I spent the summer with a 24” M1 iMac on my desk and loved it. The elegant simplicity of an all-in-one Mac with just a couple of cables trailing off the back side of the computer is wonderful. The all-in-one design of the M1 iMac wasn’t new, but it was a stunning departure from its predecessor, with a slim, flat design that wasn’t possible in the Intel era. Plus, it came in a variety of vibrant, fun colors, which is all too rare in Apple’s product lineup.

Today, Apple announced the successor to that iMac that features an all-new M3 chip that, by Apple’s account, is ‘scary fast.’ Just how fast the new iMac is compared to other models will require hands-on testing, but from the specs alone, the new iMac is impressive.

Let’s take a look.

Read more

Has Apple Overshot the Market with the New Mac Pro?→

Source: Apple.

Source: Apple.

Monica Chin, writing for The Verge, interviewed more than 20 professionals to try to figure out who the Mac Pro is for and gauge interest in Apple’s most powerful desktop computer:

I wanted to know whether Apple’s purported target demographic — people who spend their days animating, making visual effects, and doing various other tasks generally associated with big, powerful computers — were actually interested in purchasing this machine. So I asked a bunch of them, and the answer, basically across the board, was no. Not because the Mac Pro is bad but because Apple’s other computers, namely its laptops, have just gotten too good.

For everyone Chin interviewed, one of Apple’s other portable or desktop options was already meeting their needs. Another potential issue for the Mac Pro is its lack of eGPU support:

The lack of support for external GPUs makes the feature particularly confounding for graphic professionals. “GPU support, that’s what we mostly use PCIe for,” said Tom Lindén, who runs a 3D animation agency. Other than a capture card, he says, “there are not that many expansion cards that would be useful.”

Between the MacBook Pro and Mac Studio, it seems that the professional market is satisfied:

“The offering across the board from Apple has gotten so powerful that, frankly, the Mac Pro feels a little unnecessary,” echoes Nathan, who has owned a number of Mac Pros throughout his career but is now very happy with his 14-inch MacBook. “I think we all appreciate it for what it is and what it demonstrates, but at no point has anyone said to me, ‘So when are we getting an office load of these?’”

The Mac Pro has always been a niche product. However, ever since it was announced, there has been a sense among many who write about the Mac that the new Pro is more niche than any of its predecessors, which is borne out by Chin’s reporting. That doesn’t make it a bad computer, but it’s also one that 99.9% of users don’t need, especially at a substantial premium compared to Apple’s other pro Macs. Absent new uses for the Mac Pro emerging, I wouldn’t be surprised if the Mac Pro doesn’t remain a product in Apple’s lineup for long.

Permalink

The Best Mac Gaming Experience Is a PC Sitting in a Dallas Data Center

I’ve seen the future of Mac gaming, and it’s not Metal 3 or Apple silicon. It’s a PC sitting in a Dallas data center with an NVIDIA 4080 GPU. That’s the data center my Mac connects to when I log into GeForce NOW Ultimate, the top tier of NVIDIA’s videogame streaming service. NVIDIA has data centers like it across the US and in Europe, streaming the latest, most demanding titles to a wide range of devices, including the Mac.

GeForce NOW is a technological marvel that turns traditional computing expectations on their head, offering Mac users a world where your Internet connection and display are more important than the computing power of the device on which a game is played. For Mac users, GeForce NOW is an opportunity to finally play the most advanced games available on the computer they love, which is exciting. However, for Apple, which has begun to market Macs as capable of playing modern games, GeForce NOW and services like it may end its AAA gaming ambitions before they leave the gate.

Read more