Rules are prompting U.S. and European banks to be smaller, more focused