You'll want to add torque boxes like from the factory as well.
Nobody is stopping you, it's your car. Just know that you'll be dealing with some bending and twisting of the chassis until you brace things.
This is probably in your future.
70-74 E Body Frame Connector for Dodge Challenger