You probably need to set the timing, too, unless it was set before. The number 1 plug should be at or around the engine's top dead center. If your engine runs clockwise, the distributer goes counterclockwise, so the next in the firing order would be counterclockwise, and etc.
If you need to find top dead center to find which is the #1 plug, you have to take off the #1 spark plug and turn the engine the way it runs, probably clockwise using a large rachet turning the bolt at the end of the crank shaft. Put your thumb or finger over the sparkplug hole while turning until the pressure pushes your thumb off, which is the pressure stroke. Now check the timing marks in back of the crankshaft pulley, they may be hard to see, but it should be near top dead center. I usually light the marks up with a silver sharpie. If you know the factory recommended timing, which say it is 10 degrees advanced, or before TDC, move the engine to the correct timing, usually an inch or so to the right. Your rotor on the distributor should be just hitting the #1 plug. After it is started, set the timing more exactly with a timing light. No, you can't just put the engine on the marks and be sure that it is TDC, because it is a four cycle, and the engine goes around twice for the whole cycle, so you may be 180 degrees off.
You may also need to find the cylinder designation to know where to put the other end of the plug wires.
NOTE: The distributer cap isn't numbered, because it depends where the distributer was installed - it could be put in at a different position meshing with the gears inside the engine that turn it.