Can someone explain what H.264 video is?

Mac
1

I keep seeing H.264 listed as the format or codec for a lot of my video files, but I’m not really sure what it means or how it’s different from other formats like MP4 or HEVC. I’m trying to choose the best settings for recording and exporting videos, and I’m worried I might be picking the wrong option and losing quality or making files too large. Can someone break down what H.264 video is, what it’s used for, and when I should choose it over other options?

2

H.264 video explained like a normal person would

H.264, also called AVC, is a video compression standard.

In plain language, H.264 takes raw video and shrinks it so it fits on your drive or goes through your internet connection without killing it. Your phone recordings, YouTube, streaming services, video calls, they lean on H.264 a lot.

I will break it down by what I have seen in real use.

What H.264 actually does

When you record or export a video in H.264, a few things happen:

• It looks at each frame and throws away visual details your eyes usually do not notice.
• It compares frames to each other so it does not store the same thing again and again. Example: background wall stays the same for 5 seconds, it stores it once and only changes the moving parts.
• It stores the video as a series of reference frames plus “difference” frames.
• Audio is usually separate, something like AAC, but wrapped in the same file container like MP4 or MOV.

So when you see a “.mp4” file, most of the time the video inside is H.264.

Why H.264 took over everything

From my own use across phones, cameras, and edits, it stands out for a few reasons:

  1. Good quality at small file sizes
    If you compare H.264 to older stuff like MPEG-2, you get similar or better quality at maybe half the file size. On a 1080p video, that adds up fast if you store a lot of footage.

  2. Plays almost everywhere
    Macs, Windows PCs, phones, TVs, cheap streaming boxes, browsers, cameras, they all support it.
    I have sent H.264 MP4s to people with ancient laptops and they still managed to play them.

  3. Works for many resolutions
    I have used H.264 for:
    • 480p screen recordings
    • 720p webcam videos
    • 1080p gameplay
    • Some 4K exports when I did not want giant HEVC files

    It handles low bitrate mobile clips and higher bitrate “nice looking” exports without changing formats.

  4. Hardware acceleration
    A lot of graphics chips decode H.264 directly. Playback is smooth and CPU usage stays low compared to older formats. This matters on laptops running off battery.

Where H.264 starts to annoy

It is not perfect and I do not use it for everything:

  1. Less efficient than newer codecs
    If you compare H.264 to HEVC (H.265) or AV1:

    • Same visual quality
    • Bigger file size
    • Or, same file size, lower quality

    For long 4K recordings or huge archives, H.264 gets expensive in storage.

  2. Licensing mess behind the scenes
    Users do not see this most of the time, but there are patents and licensing groups around H.264.
    This is one reason some open source tools and browser decisions took odd routes.

  3. Quality at very low bitrates
    When you crush the bitrate a lot, H.264 starts to show blocky patches, smearing in fast motion, and macroblocking in dark scenes. Newer codecs handle “bad bitrate” situations a bit better.

  4. Heavy 4K and high frame rate workflows
    Editing H.264 4K or 60+ fps on weaker machines feels laggy. Scrubbing the timeline stutters. H.264 was designed with certain trade-offs, and timeline editing at high resolutions is not its strong side.

Where I usually use H.264 anyway

• Sharing with people who are not into tech
• Uploading to sites that like MP4
• Quick exports for review
• Archive stuff where “small enough and plays everywhere” matters more than perfect efficiency

Players I would pick for H.264

• Elmedia and QuickTime on macOS
• SMPlayer and PotPlayer on Windows

All four handle H.264 fine, but each one fits a different kind of user. I will go through them the way I have used them.

Elmedia Video Player on Mac

I used Elmedia when I was tired of QuickTime saying “unsupported format” on random files.

What I noticed:

• Plays almost anything
H.264 in MP4, MKV, MOV, etc. Subtitles, different audio tracks, all of that worked out of the box.

• Better controls than QuickTime
• Playback speed with finer steps
• Subtitle offset when sync is off
• Easy A-B repeat for looping segments

• Streaming to other devices
I pushed videos to a TV from my Mac using Elmedia, worked smoother than trying to wrestle with built-in tools.

When I tell people to use it:
When they want “VLC-style” flexibility but on Mac with a nicer interface and they watch mixed types of video files, not only stuff from Apple gear.

QuickTime Player on Mac

QuickTime is already on your Mac. I still use it for simple H.264 stuff.

What it does well:

• Native integration
H.264 in MOV or MP4 made by iPhone, iPad, or macOS screen recording runs smooth. CPU stays low, battery usage looks reasonable.

• Clean and simple
Drag, drop, play. No endless settings.
Scrubbing through clips feels precise and snappy, especially with the trackpad.

• Quick trimming
For basic edits like trimming the start and end of a clip, it is faster than opening a full editor. You trim and export the H.264 file again.

Where it starts failing:

• Limited format support
When the file came from some Windows screen capture or a random camera, QuickTime sometimes refused or played without sound.

• Fewer advanced playback tools
If you want detailed subtitle controls, audio track tweaking, or looping, QuickTime feels bare.

I still use QuickTime for:
Short H.264 clips from my phone, screen recordings, and anything where I do not need filters or advanced options.

SMPlayer on Windows

I used SMPlayer when I got fed up with VLC configs on an older Windows laptop.

Some things I liked:

• Uses MPV or MPlayer under the hood
Those engines handle H.264 very well. They work ok even on low power hardware.

• Plays almost every format
Every H.264 file I threw at it worked, whether it was inside MP4, MKV, or something odd.

• Saves settings per file
This was useful. SMPlayer remembers where you stopped, volume level, and subtitle track per video. Pick up right where you left off without thinking.

• Subtitle handling
It finds and loads external subtitle files easily. Sync adjustment is simple too.

Why I point people to it:
When they want free, open source, solid playback on Windows and do not care about fancy looks. It is more about function than style.

PotPlayer on Windows

PotPlayer is the one I saw people use when they want lots of control.

From my experience:

• Very smooth playback
H.264 at 1080p and 4K played fine, even on midrange hardware, once hardware acceleration was set up.

• Tons of settings
• Detailed control of hardware decoding
• Video filters and post-processing
• Fine grain subtitle styling and sync
• Keybindings and mouse controls everywhere

I pick PotPlayer when:
I want maximum control on Windows, plan to watch a lot of local files in H.264 and other formats, and might need tuning for quality vs performance.

All four handle H.264 without drama in most cases. The difference is how much control you want, how many format quirks you hit, and whether you care about simple interface or extensive settings.

1 Like
3

H.264 is one thing. MP4, MOV, MKV and so on are another thing.

Think of it like this:

• H.264 = codec. The method used to compress and decode the video.
• MP4 / MOV / MKV = container. The box that holds the video stream, audio stream, subtitles, etc.

So when you see “H.264, MP4” for a file, that usually means:

• Container: MP4
• Video codec: H.264
• Audio codec: often AAC

HEVC (H.265) is the successor to H.264. Same idea, newer math.

Rough practical differences:

• H.264 vs HEVC (H.265)

  • For the same quality, HEVC often gives about 30 to 50 percent smaller files.
  • For the same bitrate, HEVC looks cleaner, especially at 4K.
  • HEVC needs more CPU/GPU to decode. Older devices struggle or refuse to play it.

• H.264 vs “MP4” confusion

  • MP4 is only a wrapper. Your MP4 file might have H.264, HEVC, AV1, or something else inside.
  • Most phones default to MP4 + H.264.
  • Newer phones offer “High efficiency” which usually means MP4 + HEVC.

For “best settings for recording or exporting” here is a simple rule set:

  1. Use H.264 when:
    • You share with people on mixed devices.
    • You upload to sites that accept nearly anything.
    • You want fewer playback problems.

    Suggested starting points:
    • 1080p 30 fps: 8 to 12 Mbps
    • 1080p 60 fps: 12 to 20 Mbps
    • 4K 30 fps: 25 to 45 Mbps

  2. Use HEVC (H.265) when:
    • You archive a lot of 4K and care about storage.
    • You know the playback devices are modern.
    • You accept some editing lag on weaker PCs.

    You can often cut those H.264 bitrates by about one third with similar quality.

  3. For editing:
    • H.264 and HEVC both feel heavy on older machines, especially 4K.
    • If your editor chokes, transcode to an editing friendly codec, like ProRes or DNxHR, for the edit, then export to H.264 or HEVC at the end.

On players, I slightly disagree with @mikeappsreviewer on one point. QuickTime is fine for simple H.264 clips, but once you start dealing with a mix of sources, MP4, MKV, odd audio tracks, it becomes annoying fast. On macOS, Elmedia Player handles H.264 in MP4, MKV, MOV with far fewer “why is there no sound” moments, and gives you more control over playback and subtitles without turning into a science project.

So, if your main question is “what do I pick in my recording / export settings”:

• Format / container: MP4
• Video codec: H.264 for compatibility, HEVC for smaller files when you trust the playback devices
• Audio: AAC
• Bitrate: use the ranges above as a baseline, raise it if you see blockiness, lower it if files are too big.

That will cover most normal use without you having to think about specs all day.

4

H.264 is the language your video is compressed in, not the box it lives in.

Think of it like this:

  • H.264 / HEVC / AV1 = codecs
  • MP4 / MOV / MKV = containers

Container is the box. Codec is how the video inside is squished.

So when you see:

  • “File type: MP4”
  • “Codec: H.264”

That usually means:
Box: MP4
Video inside: H.264
Audio inside: something like AAC

MP4 is not “worse” or “better” than H.264; they are different layers. That’s where a lot of confusion comes from.

Compared to what @mikeappsreviewer and @mike34 already wrote (and they covered the human explanation well), I’ll push a bit on one point:

They lean pretty hard on “H.264 is good for everything.” It’s fine for almost everything, but once you hit high-res and long runtimes, the storage waste vs HEVC or AV1 becomes non‑trivial. If you’re shooting hours of 4K, staying on H.264 “for compatibility” can be a pretty expensive habit.

Very quick, no-nonsense way to choose:

1. If you just want stuff to play everywhere right now

  • Container: MP4
  • Video codec: H.264
  • Audio: AAC
  • Bitrate ballpark:
    • 1080p30: ~8 Mbps
    • 1080p60: ~12–16 Mbps
    • 4K30: ~30–40 Mbps

This is basically the “boring, safe, it’ll work on grandma’s TV” preset.

2. If your audience and devices are modern

  • Same as above, but codec: HEVC (H.265)
  • Drop those bitrates by ~30–40% and you’ll get similar visual quality.
  • Downside: older TVs, ancient laptops, and some browsers choke or refuse.

3. For editing

H.264 and HEVC both kinda suck to edit, especially at 4K. If your timeline is laggy as hell:

  • Transcode to an “intra-frame” codec like ProRes or DNxHR
  • Edit smoothly
  • Export the final video as H.264 or HEVC

People often blame their editor when the real problem is that H.264’s compression tricks are just not editor-friendly.

As for playback:

  • On macOS, I slightly disagree with the “QuickTime is enough” angle. It’s fine for super clean Apple-origin clips, but once you mix in weird MP4/MKV files, multiple audio tracks, odd subtitles, etc, QuickTime gets annoying fast.
  • Elmedia Player handles H.264 in MP4, MKV, MOV way more reliably and gives you practical stuff like subtitle offset, audio track control, streaming to TV, etc, without feeling like a nerd tool. If you’re troubleshooting “why does this H.264 MP4 from random software have no sound,” Elmedia Player is usually the faster fix than poking QuickTime.

So, tl;dr for your settings:

  • If you don’t want to think: MP4 + H.264 + AAC, with the bitrates above.
  • If storage really hurts and everything you use is fairly new: switch to HEVC.
  • Remember: “MP4” tells you the box, “H.264 / HEVC” tells you what’s actually squeezing the video inside.
5

Think of H.264 as the recipe, not the dish.

MP4 / MOV / MKV = the dish on the plate.
H.264 / HEVC / AV1 = the recipe used to cook the video.

So yes, the others already nailed “codec vs container.” I’ll add what that actually means when picking settings and players without rehashing all their bitrates.

How H.264 behaves in the real world

Where I slightly disagree with @mike34 and @mikeappsreviewer: H.264 is not just “fine for everything.” Once you hit long 4K footage, it starts to look like a storage tax compared to HEVC or AV1.

Think in terms of “what hurts more”:

  • If you care about compatibility pain, pick H.264.
  • If you care about storage pain, pick HEVC (or AV1 when supported).

For most 1080p social / YouTube content, H.264 is still the sweet spot. For multi-hour 4K, I would seriously question staying on H.264 unless you know lots of viewers are on older hardware.

H.264 vs HEVC vs AV1 in one sentence each

  • H.264 (AVC): Plays almost everywhere, not the most efficient, very safe choice.
  • HEVC (H.265): Smaller files at same quality, needs newer devices, some editing apps struggle.
  • AV1: Even better compression, support is growing but not universal, encoding is slow on many systems.

If you are confused by “best settings,” ask yourself:

“Who is watching this, and what devices do they have?”

That answer matters more than the spec sheet.

About players & H.264, especially on Mac

On macOS, personally I outgrow QuickTime pretty quickly once I move beyond “clips from my iPhone.”

QuickTime strengths:

  • Very smooth with Apple-made H.264 / HEVC.
  • Nice scrubbing and basic trim.
  • Zero setup.

QuickTime headaches:

  • Chokes on some MP4/MKV with odd audio tracks.
  • Weak subtitle control.
  • Limited tweaking for playback and quality.

This is where Elmedia Player becomes useful.

Elmedia Player: pros & cons for H.264 use

Pros:

  • Plays H.264 inside MP4, MKV, MOV and other containers with fewer “no audio” or “unsupported” surprises than QuickTime.
  • Good subtitle control (offset, style) which is a lifesaver with downloaded content or fan subs.
  • Multiple audio tracks handling is straightforward.
  • Casting / streaming to TVs and external devices works well for local H.264 collections.
  • Interface is friendlier than many “power user” players, so you do not have to camp in settings.

Cons:

  • More features than casual users strictly need, so it can feel like overkill if you just open iPhone clips.
  • Some advanced options are a bit buried compared to ultra-geek tools.
  • Not as tightly integrated into macOS workflow as QuickTime for quick trims and shares.

If your life is mostly “record in H.264 or HEVC, then watch and share,” I’d keep both:
QuickTime for quick Apple-native stuff, Elmedia Player for everything else that gets weird.

On Windows, the angles from @yozora and @mikeappsreviewer are fair. SMPlayer is a nice “just works” choice, PotPlayer is the tweak monster. They all handle H.264 fine; you just pick between simplicity and control.

Simple practical rule set that complements what’s already said

Instead of more numbers, use these decision prompts:

  1. Sharing with random people or clients?
    Record / export to H.264 in MP4. You avoid support calls.

  2. Archiving lots of 4K and you own the playback hardware?
    Use HEVC in MP4 or MKV. Test files on your TV / laptop first to be sure.

  3. Editing feels laggy?
    Problem is usually the long-GOP nature of H.264 / HEVC, not your “format choice.”
    Transcode to an intra-frame codec for editing, then export to H.264 or HEVC at the end.

  4. Unsure what’s actually inside your file?
    Use a media info tool in your editor or player and check the video codec line: H.264, HEVC, AV1, etc. MP4 alone tells you almost nothing.

Once you think in terms of “box vs recipe,” H.264 stops being mysterious and just becomes the very common recipe you pick when you want the fewest headaches.