Obama's poll numbers will worsen after meeting