Replacing a 40-gallon water heater with a tankless system is a big step for many homeowners. People often wonder: Is it worth the effort and cost? Will I really save money? Is it hard to install? These questions—and many more—can make the change feel overwhelming. But with the right information, you can make a clear, confident decision. This guide explains every part of the process, from understanding why you might want to switch, to tips for choosing the right tankless heater, and even what mistakes to avoid. If you’ve ever thought about making your hot water system more efficient, reliable, and modern, this article is for you.
Why Replace A 40-gallon Water Heater With Tankless?
Traditional tank water heaters have been in homes for decades. They store a set amount of hot water, usually 40 gallons, and keep it warm all day. But they use energy even when you’re not using hot water. Tankless water heaters, sometimes called on-demand water heaters, heat water only when you turn on the tap. This means you’re not paying to keep water hot all day long.
Key reasons to switch:
- Energy savings: Tankless systems can save up to 34% on water heating costs for homes that use less than 41 gallons per day.
- Endless hot water: You never run out, even if your family takes back-to-back showers.
- More space: Tankless units are small and can be wall-mounted, freeing up floor space.
- Longer lifespan: On average, tankless heaters last 20 years or more, compared to 10-15 years for tanks.
Still, the switch is not simple. Many factors need to be considered before you remove your old 40-gallon tank and install a tankless system.
1. Understanding Your Current Hot Water Needs
Before you buy anything, it’s important to know how much hot water your home uses. A 40-gallon tank works well for many families, but tankless systems need to be sized correctly.
Calculating Demand
Think about:
- How many showers, sinks, and appliances use hot water at the same time?
- Do you often run the dishwasher and washing machine together?
Example: If two people take showers at once (about 2 gallons per minute each) and someone uses the kitchen sink (1.5 gallons per minute), your demand could be 5.5 gallons per minute (GPM).
Non-obvious insight: Many people forget to include appliances like washing machines or dishwashers in their calculations.
2. Knowing The Flow Rate Needed
Tankless heaters are rated by flow rate, measured in gallons per minute (GPM). This number shows how much hot water the unit can provide at one time.
Matching Flow Rate To Your Home
- Small homes: 4–6 GPM may be enough.
- Larger homes or families: 7–10 GPM is better.
Tip: Don’t just look at the biggest number on the box. The actual flow rate depends on the temperature rise (how much the heater must heat the water).
3. Temperature Rise And Local Groundwater
Tankless systems must heat cold water as it enters your home. The colder your groundwater, the harder the system must work.
Calculating Temperature Rise
- Find your incoming water temperature (often 40–55°F in the northern US).
- Decide your desired hot water temperature (usually 120°F).
- Subtract: 120°F – incoming temperature = temperature rise needed.
Example: If groundwater is 50°F, the heater must increase it by 70°F.
Non-obvious insight: If you live in a cold area, you may need a more powerful unit or two smaller units in parallel.
4. Gas Vs. Electric Tankless Water Heaters
There are two main types: gas-powered and electric. Each has pros and cons.
Gas Tankless Heaters
- Heat water faster
- Usually higher flow rates
- Need venting to the outside
- Often cost more to install
Electric Tankless Heaters
- Simpler to install (no venting)
- Lower upfront costs
- Often need a big electrical upgrade
- Best for smaller homes or point-of-use
Tip: If your home already has natural gas, a gas unit might be easier. If not, electric could be more cost-effective.
5. Sizing The Tankless Water Heater
Getting the right size is critical. Too small, and you run out of hot water. Too large, and you waste money.
Sizing Steps
- List all hot water fixtures and appliances.
- Add up total GPM used at peak times.
- Check the temperature rise needed.
- Match these numbers to available units.
Example Table: Comparing Sizing for Different Homes
| Home Type | Peak GPM Needed | Temperature Rise Needed | Recommended Tankless Size |
|---|---|---|---|
| Small Apartment | 3 GPM | 60°F | Electric (12 kW) |
| Family Home | 7 GPM | 70°F | Gas (180,000 BTU) |
| Large Home | 10 GPM | 60°F | 2 Gas Units (150,000 BTU each) |
6. Assessing Your Home’s Gas Or Electric Supply
A tankless water heater can need much more power (gas or electric) than a tank.
Gas
- Many tankless units need a ¾-inch gas line, while old tanks use ½-inch.
- You may need to upgrade your gas line.
Electric
- May require a 200-amp panel.
- Each unit could need two or three 40-amp breakers.
Non-obvious insight: Upgrading your gas or electric lines can be more expensive than the heater itself.
7. Venting And Air Supply
Gas tankless heaters must vent exhaust gases safely outside.
- Direct venting is safest and most common.
- Vent pipes are usually stainless steel and must meet code.
Tip: Check if you have space for new vent pipes or if walls need to be opened.
8. Space And Mounting Location
Tankless units are much smaller than tanks, but they have specific needs.
- Must be mounted on a wall, often near where water enters the home.
- Need at least 12–24 inches of clearance for servicing.
- Can be installed indoors or outdoors (with proper models).
9. Water Quality And Hardness
Hard water causes scale buildup inside tankless heaters, which reduces efficiency.
- If you have hard water, consider installing a water softener.
- Some tankless units have built-in scale reduction, but extra protection is best.
Tip: Regular descaling is key for long life.
10. Permits And Local Codes
Most cities require permits to install a new water heater, especially if gas or electrical work is involved.
- Check with your local building department.
- Some areas have strict rules on venting and gas lines.
Non-obvious insight: Skipping permits can cause problems if you sell your home or have a warranty issue.
11. Removing The Old 40-gallon Tank
Taking out your old tank is a job in itself.
- Turn off power or gas and water supply.
- Drain the tank fully before moving.
- Tanks are heavy—get help or use a hand truck.
Tip: Some cities have programs to recycle old water heaters.
Credit: www.amazon.com
12. Preparing The Plumbing
Tankless units often have different pipe layouts than tanks.
- You may need to reroute hot and cold water lines.
- Proper shut-off valves and unions are essential for future maintenance.
Tip: Install isolation valves to make future descaling easy.
13. Upgrading Gas Or Electrical Lines
Many homes need upgrades before installing a tankless heater.
- For gas: A larger line, sometimes from the meter.
- For electric: New breakers and wiring.
Example Table: Upgrade Requirements
| Type | Old Tank Heater | Tankless Upgrade |
|---|---|---|
| Gas Line Size | ½ inch | ¾ inch |
| Electrical Panel | 100 amp | 200 amp |
| Breaker Requirement | 1 x 30 amp | 2–3 x 40 amp |
14. Choosing The Right Brand And Model
Not all tankless heaters are equal.
- Look for brands with strong reviews and good warranties.
- Consider features like remote controls, Wi-Fi, and recirculation pumps.
Popular brands: Rinnai, Navien, Rheem, Noritz, EcoSmart.
15. Energy Efficiency Ratings
Check the Energy Factor (EF) or Uniform Energy Factor (UEF).
- Higher numbers mean better efficiency.
- Gas units usually have UEF of 0.82–0.95; electric models can be even higher.
Non-obvious insight: An efficient unit saves money over time, even if it costs more upfront.
16. Cost Of Equipment
Tankless water heaters cost more to buy than tank models.
- Gas units: $800–$2,500
- Electric units: $500–$1,500
Tip: Don’t forget extra costs for venting, water softeners, or recirculation pumps.
17. Installation Costs
Professional installation is often needed.
- Labor: $1,000–$3,000, depending on upgrades needed.
- More if you need new gas lines, venting, or electrical work.
Example: Total cost (equipment + installation) can be $3,000–$5,000.
18. Rebates And Incentives
Some states and utilities offer rebates for switching to energy-efficient water heaters.
- Federal tax credits may be available.
- Check local programs for extra savings.
19. Water Pressure Requirements
Tankless heaters need a minimum water pressure to work well.
- Most require at least 30–50 psi.
- Low pressure can cause the heater to shut down.
Tip: Check your home’s water pressure before buying.
20. Maintenance Needs
Tankless heaters need regular care to last.
- Annual descaling for hard water areas.
- Flushing the heat exchanger.
- Checking the vent and air intake.
Non-obvious insight: Skipping maintenance can void the warranty.
21. Warranty Coverage
Warranties vary by brand and model.
- Heat exchangers: Often 10–15 years
- Parts: 5–10 years
- Labor: 1–5 years
Tip: Keep proof of professional installation to maintain warranty.
Credit: insidepersonalgrowth.com
22. Lifespan Compared To Tank Heaters
Tankless water heaters usually last longer.
- Tank: 10–15 years
- Tankless: 20+ years with proper care
23. Endless Hot Water Supply
With the right size, you never run out of hot water.
- Perfect for families with high demand.
- Great for soaking tubs or long showers.
24. Hot Water Delay
Tankless heaters take a few seconds to heat water.
- There may be a short delay before hot water reaches the tap.
- A recirculation pump can fix this if needed.
25. Noise Levels
Tankless units can make noise when running.
- Clicking, fan noise, or burner sounds are normal.
- Usually quieter than a heating tank refilling.
26. Environmental Impact
Tankless heaters use less energy overall.
- Lower CO2 emissions for gas models.
- No standby heat loss (unlike tanks).
Tip: Choose a high-efficiency model for the best results.
27. Space Savings
Tankless units are compact.
- Wall-mounted, freeing up floor space.
- Good for small homes or apartments.
28. Safety Features
Modern tankless heaters have smart safety features.
- Flame failure sensors
- Overheat protection
- Freeze protection (for outdoor models)
Tip: Read the manual to know what your unit offers.
29. Remote Controls And Smart Features
Many new models offer:
- Digital temperature controls
- Wi-Fi connectivity to monitor or change settings
- Fault alerts
Example: Adjust water temperature from your phone.
30. Installation Time
Replacing a 40-gallon tank with a tankless heater can take:
- 6–10 hours for simple jobs
- Up to 2 days if upgrades are needed
31. Choosing Indoor Vs. Outdoor Units
Some tankless heaters are made for outdoor use.
- Outdoor units save indoor space and are easier to vent.
- Must be protected from freezing.
Tip: Indoor models are better in very cold climates.
32. Using Recirculation Pumps
A recirculation pump keeps hot water moving through your pipes, so you get hot water faster.
- Cuts down wait time at the tap.
- Can be set on a timer or sensor.
33. Matching Your Plumbing Layout
If your old tank was far from your bathrooms, you may need extra piping or a second tankless unit.
- Large homes sometimes use two units in parallel.
- Or, install smaller point-of-use units.
34. Dealing With Power Outages
Electric tankless heaters stop working during power outages.
- Gas units need electricity for controls, so they also stop in blackouts.
- Consider a backup power source if outages are common.
35. Cold Water Sandwich Effect
Sometimes, you might feel a burst of cold water between hot flows.
- Happens when water left in the pipe cools.
- Recirculation pumps or newer units can reduce this effect.
36. Common Installation Mistakes
- Choosing the wrong size unit
- Not upgrading gas/electric lines
- Poor venting
- Skipping permits
Tip: Hire a professional if you’re unsure.
37. Future-proofing Your System
Think about possible home changes:
- Adding bathrooms or appliances?
- Will your family grow?
Get a tankless heater with a bit more capacity than you need now.
38. Resale Value And Home Appeal
A modern tankless heater can add value to your home.
- Seen as an upgrade by buyers
- Lower utility bills appeal to many
39. Comparing Monthly Energy Bills
After switching, many homeowners see lower bills.
- Energy Star says tankless heaters save $80–$100 per year over tanks.
Example Table: Energy Cost Comparison
| Heater Type | Annual Energy Use (kWh/therms) | Estimated Annual Cost |
|---|---|---|
| 40-Gallon Tank (Gas) | 258 therms | $350 |
| Tankless (Gas) | 199 therms | $270 |
| 40-Gallon Tank (Electric) | 4,800 kWh | $630 |
| Tankless (Electric) | 3,400 kWh | $445 |
Credit: www.cartersmyplumber.com
40. Learning From Real-world Experiences
Talk to neighbors or friends who have switched to tankless.
- Ask about their installation, usage, and bills.
- Look for reviews from real users.
Non-obvious insight: Sometimes, user reviews mention issues or benefits not found in product manuals.
For more technical details, see the Department of Energy’s official guide.
Frequently Asked Questions
How Much Does It Cost To Replace A 40-gallon Water Heater With A Tankless System?
The total cost usually ranges from $3,000 to $5,000. This includes the price of the tankless unit, any needed upgrades to gas or electrical lines, venting, and professional installation.
How Long Does It Take To Install A Tankless Water Heater?
A simple swap can take 6–10 hours. If you need to upgrade gas or electric lines, or reroute plumbing, it may take up to two days.
Can I Install A Tankless Water Heater Myself?
It is possible for skilled DIYers, but most people hire a professional. Mistakes can be costly and may void the warranty or break local codes.
Will A Tankless Heater Work For A Large Family?
Yes, but you must buy a unit with the right flow rate and temperature rise. Sometimes, two units are installed in parallel for very large homes.
Do Tankless Water Heaters Need Maintenance?
Yes. Regular descaling and flushing are needed, especially in hard water areas. Annual maintenance helps keep the unit efficient and protects the warranty.
Replacing a 40-gallon water heater with a tankless system brings many benefits—energy savings, endless hot water, and more space. But every home is different, and careful planning is needed. By considering all 40 factors above, you can make the switch with confidence and enjoy reliable hot water for years to come.