M2 max vs nvidia reddit

M2 max vs nvidia reddit. The specs above are basically what I have now, and while it chews through whatever I throw at it, games that have implemented most or all of Nvidia’s performance-focused features (DLAA, PhysX, Raytracing, Reflex, etc. 6-4. Remember, apple's graphs showing how great their chip is relative to intel/nvidia, are relative to power window. I currently work in a research lab with hundreds of thousands of dollars worth of NVIDIA-GPUs, so I don’t necessarily need the GPU upgrade, but I think it may be helpful to run smaller scale experiments when my labs GPUs are overloaded. 7 tok/s on q4_0 65b guanaco, and on the 4090+i9-13900K Good point. I am not sure how fast is 38 core GPU but if you want to compare it with Nvidia cards which I have 3070 - 180 Watt version it is faster than M2 Max 30 core. 1 t/s (Apple MLX here reaches 103. It uses the unified memory Not needing to be upgraded in the near/foreseeable future? 4K 144 FPS at max settings is the goal. That's why Nvidia tried to sell Apple on it's 9400m/9600m GPUs only to get burned by Intel patents back in 2008. Not clear. I can always get an external ssd for more storage, but memory is impossible to expand. If your workflow demands a lot of CPU and GPU power, then M2 Ultra is worth it. We're using an iPad Air as a second monitor for bins, program windows and notes, then the laptop screen is used for the timeline, source monitor, program monitor and audio levels. I'm expecting much improved performance and speed. Parallels gets it warmer but bearable. 95/963. If you are into professional workloads, then decide what software you want first. 6'', M2, 24GB, 10 Core GPU. The graphics card has no dedicated An M2/M3 will give you a lot of VRAM but the 4090 is literally at least 20 times faster. Ofc comparing 2023 silicon vs 2022 nvidia would be more fair but we didnt see 4000series yet so hold your praise. I’m seeing early benchmarks and this iteration of the Mac Studio seems to scale way better than previous M1Max-M1Ultra… What do you think? I mean the M2 Max is 38-core. I am a software developer and would use my laptop for both work ( remote login to a build machine for building code and deployment, so not building on local system) and personal use ( largely general computing, have consoles for gaming ) . 48/3. 2 t/s) 🥈 Windows Nvidia 3090: 89. Nvidia only releases a new series every 2-3 years whereas Apple releases a new chip with more core once a year now. Tips Nvidia RTX A2000 6GB vs 12GB for my use case TBH the value of the M1 Macs is the RAM. You can find GB5 instances where the M2 Max scores towards 2065+ on ST, which is not seen for the base M2, ever (which trends towards mid 1800's to very low 1900's). I’m able to silently use it all day without worrying about a plug, that’s something my XPS 13 with a 12th gen Intel can’t do. When looking at videos which compare the M2s to NVidia 4080s, be sure to keep an eye out for the size of the model and number of parameters. You may tell that "they suck more energy", however, most of the times you will stay plugged, due to the fact the game is power consuming. And M2 Ultra can support an enormous 192GB of unified memory, which is 50% more than M1 Ultra, enabling it to do things other chips just can't do. My rough feeling is like 3060/3070 ish for max models? But on the other hand it can be greater if we see people pushing 4k? Testing was conducted by Apple in November and December 2022 using preproduction 16-inch MacBook Pro systems with Apple M2 Max, 12-core CPU, 38-core GPU, 96GB of RAM, and 8TB SSD, as well as a production Intel Core i9-based PC system with NVIDIA Quadro RTX 6000 graphics with 24GB GDDR6 and the latest version of Windows 11 Pro available at the definitely not, however i can't wait to see benchmarks that compare say the M1 Max with a specced-out M3 Max. My M2 MBA is fine for what it is. 11x blender open data: 1915. I dont want people to get the impression that everywhere its 2x as fast or its faster at all in many places. The M3 Max GPU should be slower than the M2 Ultra as shown in benchmarks. Apple's results were still impressive, given the power draw, but still didn't match Nvidia's. 78 = 1. That allows them to use M3 Max chips that don't pass full QC. My exposure is mostly around Jupyter books on Colab Pro+ (A100s) and nvidia 3080 GPUs (locally). 2 q4_0. It says "matching" uses 30% less power - not beating it. M2 Max with tons of ram is amazing. the MacBook Air 13. M3 represents the newest 3nm tech, ultra low power, low heat, high performance which all fits in a slim laptop and achieves excellent battery life. My work PC is an i7 8700K, 32GB RAM and a 2080ti. I don't know how much of a difference you'd see with the M2 pro vs Max on the development side - my guess probably not much. I recently saw a post in an FB group of an editor saying they've edited an 1h20m 4K corpo documentary on a M1 Max 32-Core MBP with fairly light VFX and editing like DeNoise and a bit of Grain and that export is taking 11h to finish. Oct 6, 2022 · Yes, the M2 will have fast graphics for an integrated solution, but what exactly does that mean, and how does it compare with the best graphics cards? Without hardware in hand for testing, we NVIDIA GPUs have tensor cores and cuda cores which allow AI modules such as PyTorch to take advantage of the hardware. Given that Apple M2 Max with 12‑core CPU, 38‑core GPU, 16‑core Neural Engine with 96GB unified memory and 1TB SSD storage is currently $4,299, would that be a much better choice? How does the performance compare between RTX 4090/6000 and M2 max for ML? Compared to the M1 Max with 32 GPU cores, the new M2 Max is around 25 % faster in emulated titles. But with M2 Max Oct 31, 2023 · Shadow of the Tomb Raider performances runs better at 1600p Highest settings on M2 Max compared to RTX 3070 Ti, however, as soon as the device is unplugged, even the game menu loses its smoothness. Not such a big deal on an M1 with 16 Gb, but perhaps something to consider when thinking about the kinds of models you can build on the M1 Max with 64 Gb or M1 Ultra with 128 Gb. Better than the Intel designs? No doubt, they were trash. Hello reddit ! Need opinions deciding between 16" M2 Max refurbished versus M3 pro. I appreciate your guidance. M1 Max 32GPU = 30 min M2 Max 30GPU = 17 min Is it worth the extra cash to go from a 12-core CPU / 38-core GPU / 96GB M2 Max to a 24-core CPU / 60-core GPU / 64GB M2 Ultra? In other words, “maxed-out” M2 Max vs “base” M2 Ultra. Oryon looks like an M2 Pro class product, not max. The top of the line M3 Max (16 CPU/ 40GPU cores) is still limited to 400GB/s max, but now the lower spec variants (14 CPU/30 GPU) are only 300GBs/max. Blender Scanlands scene render takes 04:10 on M2 Max, 01:06 on 3070 Ti; however when unplugged it takes 06:58 on Windows laptop. 55/380. Also, they should probably be comparing to M2 Pro - not Max for ST. Faster than 3060 but slower than 3070. I'm planning on handling large text models as well as image analysis. So take this with a grain of salt, but I just got the MacBook Pro 14 with the M2 Max and it's the best experience I've ever had with Premiere and After Effects. 02x blender open data: 963. 08/380. You'd have to edit H265 on a PC with specific H265 accelerators to beat the Mac at editing (which few professionals do). Jul 1, 2023 · Apple M2 Max 38-Core GPU remove from comparison. With the M1 & M2 Max, all the GPU variants had the same memory bandwidth (400GB/s for the M2 Max). Since apple has released 3 generation of M-series chips, how is the media engine in M3 series compared to nvenc in RTX4090 in HEVC video quality? Thanks. RTX 3060 clearly outperforms M1/M2 Pro on Max Settings. Runs warm just watching YouTube. So if they downclock to get a 2800 score, it uses 30% less power than M2 Max. I am considering either the 32GB M2 Pro or the base M2 Max. Apple cant compete with Nvidia in 3d rendering. what about more power efficient games? Take a look at Resident Evil Village, for example. "Finally, the 32-core Neural Engine is 40% faster. com Jul 1, 2023 · Thanks to the additional cores and architectural improvements, the M2 Max GPU should clearly best the old M1 Max GPU with 32 cores and therefore be the fastest iGPU currently available. M2 Max is always much more efficient for the smallest models than V100. So that kinda gave me a bit of anxiety, because I'm going to be coughing up a lot of money for a M2 Max machine. The one with the 4090 will likely be equipped with a top end CPU as well and when plugged in will definitely be better than the air m2. M1 is for sure more efficient, but it can't be cranked up to power levels and performance anywhere near a beefy cpu/gpu. The difference between these two in cost is ~$250. I should probably explain what I want to do as well. 18x blender open data: 690. So in a certain sense of wanting Apple's best on ST they weren't wrong there. The Asus X13 runs at 5. 55 = 1. A few Mac publications gleefully posted that the M1's GPU's performance is that of an Nvidia GeForce GTX 1050 Ti, an ultra-budget GPU released in 2016 with an MSRP $109 at launch. e. Playing games, native and under Parallels, gets it hot enough that I had to get a cooling pad. Photoshop and lightroom we'll see. but I averaged 70 FPS on the Nvidia 4060 and 60 on the M2 PRO in a single player race on the same track with the same cars. They run very well (especially Witcher 3), but GeForce GPUs are just superior. By the time either the M3 Max or M4 Max come out, that'll be running the equivalent of the M2 Ultra (4080) in a laptop that can last for days, or at least several times longer than a Windows gaming laptop when gaming. 81x m2 vs m2 pro: classroom render: 188s/93s = 2. Intel and Nvidia are on the back foot. The M2 Max's ST does differ though, it's 3. However, for laptops I still recommend the apple if you plan on doing any work away from a power source (i. Is that the best price/performance going? m2 10C vs m3 10C: Classroom render: 188s/ 86s = 2. Feb 19, 2023 · When paired with a powerful video card such as the Nvidia RTX 4090 as MSI did with its Raider GE78HX 17-inch notebook — the performance does indeed beat out the M2 Max quite substantially in Generating a 512x512 image now puts the iteration speed at about 3it/s, which is much faster than the M2 Pro, which gave me speeds at 1it/s or 2s/it, depending on the mood of the machine. I'm also confident that you can get a 3080 laptop at a much cheaper rate than M1 Max. However, I don't know how clearly the CompSci theory (M2 Max's 38-core GPU, 16 core Neural Engine accessing 96 GB unified memory) maps out to the IT reality (toolkits and libraries on macOS actually using it). The industry is completely asleep at how giant an accomplishment it is for the M3 max to be competing with a 3080 when Intel/AMD integrated graphics are a joke. 6 t/s 🥉 WSL2 NVidia 3090: 86. PS:I remember apples with apples hahaha comparison last year ryzen+3060 vs so i googled. Yesterday I did a quick test of Ollama performance Mac vs Windows for people curious of Apple Silicon vs Nvidia 3090 performance using Mistral Instruct 0. For example, in a single system, it can train massive ML workloads, like large tra So given the stuff in the last few days with the protingn gram work and before that with some native games like no man’s sky. 78 = 2. I recently got an MBP with m2 max and 96gb of ram for $3989 before tax and it’s significantly faster and stronger than I was expecting. 1 t/s You're much better off with a pc you can stuff a bunch of m2 drives and shitloads of ram in. Worth noting that while M1's performance vs 12900H aligns closer to SPECint results when looking just at the integer sub-score, the opposite happens with 6900HS (1774 vs 1465, ~21%). I think getting at least 64 or 96gb of ram is more important than the processor for most people. Shadow of the Tomb Raider on the Macbook has ambient occlusion set to slightly less demanding BTAO vs HBAO+ on 3060. At the moment, m2 ultras run 65b at 5 t/s but a dual 4090 set up runs it at 1-2 t/s, which makes the m2 ultra a significant leader over the dual 4090s! edit: as other commenters have mentioned, i was misinformed and turns out the m2 ultra is worse at inference than dual 3090s (and therefore single/ dual 4090s) because it is largely doing cpu If you're talking about screen real estate - 3024x1964 vs 3456x2234, that doesn't really matter to us. outside somewhere with no power plugs like a coffee shop or somewhere in uni). However, the MacBook only runs q4_0 models at the moment and most 13B models can be run; on the Asus, 30/33B models can be The truth is that M1 Ultra is not their flagship chip, it is the most powerful M1 chip but the Mac Studio is not meant to be their most powerful desktop, that will be the new Mac Pro so they didn’t had a reason to add more pins to connect another 2 M1 Max (the M1 Ultra is made of 2 M1 Max linked with a very fast connection). 2 tokens per second. 5ish on the others. 47 tokens per second. In the end, the MacBook is clearly faster with 9. This is a quote of their claim: For the most graphics-intensive needs, like 3D rendering and complex image processing, M1 Ultra has a 64-core GPU — 8x the size of M1 — delivering faster performance than even the highest-end PC GPU available while using 200 fewer watts of power. Includes M2 Max & M2 Ultra stats, some M2 Pro numbers on an Issue, and lots and lots of nvidia card combinations. Get the Reddit app Scan this QR code to download the app now or M2 Pro and notebook running on a remote server with Nvidia GPU than having M2 Max. Overall I do think that apple is definitely more impressive, inference wise I was personally getting more tok/s on the M2 with gpu accel, I hadn’t tried GPTQ though as I was mainly focusing on larger models (that a 4090 can’t load on its own), with the M2 Max I was getting around 4. It’s nvidia vs Apple silicone gpu with similar (tgp (power draw) YouTubers do the similar things back then M1 Max was around 1070 mobile raw performance, considering mobile 1070 raw performance almost similar to 3060 one when I correctly remember, I think m2 max can surpass it on compatible titles that optimised on apple silicone. The same VGG ML model finishes in 13 minutes with Nvidia 3070 card. Honestly I think Apple is slowly catching up to Nvidia. If it is available on Mac, then go ahead with a new M2 Pro/Max powered computer since you are comfortable with a Mac anyway. Though the GB FP score for 6900HS vs 12900H lines up very closely with SPEC2017 FP score (2105 vs 1891, ~11%). I’m also considering the Ultra because of the bandwidth and increased cores but will probably end up with the M2 Max MBP. Of course, we’re talking about the new 38-core GPU inside the M2 Max, which is going against the RTX 3080 Ti (Laptop). I would still say it is on the same level as GTX 1650. Jul 1, 2023 · Apple M2 10-Core GPU remove from comparison. I had a M2 Pro for a while and it gave me a few steps/sec at 512x512 resolution (essentially an image every 10–20 sec), while the 4090 does something like 70 steps/sec (two or three images per second)! Dec 13, 2023 · M1 Pro took 263 seconds, M2 Ultra took 95 seconds, and M3 Max took 100 seconds. Here results: 🥇 M2 Ultra 76GPU: 95. You should match the graphics settings. M3 Max 14 core CPU, 30 core GPU = 300 GB/s M3 Max 16 core CPU, 40 core GPU = 400 GB/s NVIDIA RTX 3090 = 936 GB/s NVIDIA P40 = 694 GB/s Dual channel DDR5 5200 MHz RAM on CPU only = 83 GB/s Your M3 Max should be much faster than a CPU only on a dual channel RAM setup. ) like Cyberpunk 2077, Dying Light 2, and A Plague Tale: Requiem will still Hi, how can you justify spending so much for the M1 MAX? Clearly 3080 laptop seems to be way better than M1 Max. So the nVidia would only be potentially double the speed. 98% m2 max vs m2 ultra An extra 200 points in single core performance for a P core would yield around ~1600 more MT points max, the increase for an E core would be around ~200, and the 2 extra E cores maybe ~1200 max, so total max 3000 and that's assuming perfect scaling (which it's not). Its performance is between 3060 - 3070. Otherwise they would just be trash. Feb 6, 2024 · M2 Max consumes between 1. Anyhow, except for the price difference of $3500 for M2 Max and low $1000 for 3060 you can't draw a conclusion from such limited number of game titles. The M2 has several ProRes accelerators (number depending on M2 flavour) that are blazing fast. The Jan 21, 2023 · To give you a sort of a preview of what’s about to come, we’re comparing the biggest and baddest GPU that Apple has to offer against NVIDIA’s most powerful laptop offering. Testing the Asus X13, 32GB LPDDR5 6400, Nvidia 3050TI 4GB vs. Cinebench is significantly faster on a 3060. Because CPU, GPU, and RAM are all on the same chip, you don’t have VRAM - just RAM. 53x m2 pro 19C vs m2 max 38C classroom render: 93s/44s = 2. M2 Max is much more efficient than V100 up to a batch size of 128 on ResNet50. Get the Reddit app Scan this QR code to download the app now M2 Pro 19-core GPU vs M2 Max 30-Core GPU . But to get the 3200 score, they might be using 30% more power than M2 Max. Factor in Office, surfing the web, and various other tasks and the XPS drops to 6-7 hours of battery life whereas my MBA (even my M1 MBA) is easily beating it. Where would be begin to estimate the relative performance of m1/m2 normal and max. The short answer: The M1 Max will have 47GB of VRAM to play with, meaning that you can fit a q8 34b into it if you want. My 4090 does about 50, but as mentioned above, has that very small memory limit compared the mac. M2 MB PRO MAX 32GB. Also why nearly all the M chips are able to be used in MacBooks, except the Ultra given its physical chip size being doubled. Inference rates roughly x2 from M2 Pro v M2 Max, and then x2 again for M2 Max v M2 Ultra, in line with their memory system speeds, though the “binning level” of the processor (-> varies number of GPU cores) also has an impact. I could do a video or images if anyone is interested in that but suffice to say Apple has left A LOT' performance on the table and more developers should notice. That said, the 3060 is only $329? I have an old PC with 32GB RAM and an RX480. This difference decreases when the batch size increases. 7GHz vs 3. . But the M2 Max gives me somewhere between 2-3it/s, which is faster, but doesn't really come close to the PC GPUs that there are on the market. The pro of buying that mac is that you can run FAR more of a model than you could hope to run in the Nvidia graphics card. I'm currently planning a 16in M2 Max, 64GB, MacBook Pro with 1TB. Here we go again Discussion on training model with Apple silicon. I have seen videos which use very small models in this comparison. You can play games like GTA V and Witcher 3, but you clearly notice that they are not optimized. Plus you can really see that CPU bottleneck when switched to 1440p as the 4080 jumps up massively in performance since higher resolutions are more GPU bound than CPU See full list on pcmag. Max RTX Some people said when exporting HEVC videos from the same davinci project, nvenc (encoder from nvidia) produces better quality than apple media engine on m1 max. On mixtral 8x7b 8quant, so 49 gigs, an m2 max (so half of an m2 ultra) does about 25 tokens a second off ollama. Most reviewers don't even include them. i have an M1 16" Macbook Pro and running the Apple Silicon version of the editor is pretty snappy - much faster than my Intel i7 MPB. Currently torn between 64GB and 96GB of RAM but I’ve been wondering what the potential benefit of that extra RAM would be if models that utilize a good percentage of it can only run very slowly. I've been using M1 Macbook Air myself, but I feel I should have gone with Nvidia RTX laptop instead as it will clearly outperform Apple in ML. If I could update the GPU there without somehow breaking it (very likely knowing me unfortunately) maybe I could save $4000. 5 and 14 times less energy than V100, depending on the model, including ResNet50 and batch size. In blender where nvidia kills everything. The Apple M2 Max 38-Core-GPU is an integrated graphics card by Apple offering all 38 cores in the M2 Max Chip. The Apple M2 GPU is an integrated graphics card offering 10 cores designed by Apple and integrated in the Apple M2 SoC. In web and software development the mac is faster. bmlhh paqg rsfw xvdyp ibgopf qnbrj zzoz mfnij pddmrc butw