Gov. Scott Walker made clear Sunday he won't back off his proposal to effectively eliminate collective bargaining rights for most public employees.