Yes, I would pull the pan and clean up the lower end. Look carefully for bearing debris. Hope you don't find any. Be careful working inside the pan. Most of those engines used leaded gasoline and the lead would settle in the bottom of the pan. Wear nitrile gloves and minimize your exposure.
Replace the pan using new gaskets and rope seals.
Next I would remove the heads and look closely for cracks around the valve seats. Wire brush around the valves and elsewhere in the combustion chamber to expose any cracks. If you can afford it take it to an engine shop that has experience with flatheads and have them inspect for cracks.
If it passes inspection look at the cylinder bores and pistons for excessive wear or scoring. Check for proper valve action too. Unstick any stuck valves too.
2002 F350 7.3 Ltr. 6sp.DRW 270K miles, 13' service body
1952 F1 flathead Project Truck
2008 Lincoln MKX
This forum is owned and operated by Internet Brands, Inc., a Delaware corporation. It is not authorized or endorsed by the Ford Motor Company and is not affiliated with the Ford Motor Company or its related companies in any way. Ford® is a registered trademark of the Ford Motor Company.