I'd say quite the opposite in terms of physicality. Joker has rarely been portrayed as a physical match for Batman. He's not that type of villain.
In fact, the very first Joker story back in 1940 had a scene where the Joker punched and kicked Batman unconscious, then pushed him off a bridge. Batman was revived by hitting the water, and as he climbed out of the river, he thought to himself, "It seems I've at last met a foe that can give me a good fight!" So the Joker was conceived from the start as a physical match for Batman. They had regular fistfights in their early encounters, from what I can find. That diminished in the '50s, but by then, comics violence was being toned down across the board.
When Denny O'Neil and Neal Adams reintroduced the Joker as a murderous character in "The Joker's Five-Way Revenge" in 1973, the very first confrontation between the Batman and Joker in the issue happened almost exactly as in their first story: Joker punches and kicks Batman in the head, knocking him out (although in this version he takes Batman by surprise rather than clocking him face-on). This version of the Joker was useless against Batman when he didn't have the element of surprise, but he was still portrayed as a spry and physical capable individual. Which seems to be consistent with his portrayal ever since. If he's less of a match for Batman in modern times, though, it's more because Batman's own abilities have been ramped up in later stories.
The Joker was pretty physical in the DC Animated Universe too. The train-top battle between Batman and the Joker at the climax of "Mad Love" (both the original comic set in the B:TAS universe and the later screen adaptation of it) also comes to mind.