[ubuntu] how to move cursor out from terminal prompt

Hello to all,

Firstly please allow to me explain more about my problem, so anyone read this don't waste time on something else. Here "terminal prompt", I mean the line with "user name @ directory $ ". It appears in the bottom of terminal whenever you finish a command.

Note: My mouse or cursor works perfectly now, and it is just that I want to do something else but I don't find a way online.

What I want:
I want to move cursor back to the command history or previous printed result in the terminal. I don't mean to scroll the screen down to see the history, but really move the cursor there to navigate.
If you want to ask for the reason: I am using byobu in terminal, which split one terminal to several sub-terminals or windows. If I use "Alt+Up/Down", I can move the cursor into previous printed history, and I can use "/ or ?" like vim after then. This is exactly what I am looking for, except that "Alt+Up/Down" jumps over too much. Since I am searching a lot, I really appreciate a more elegant way to just take the cursor out from prompt.

This may be very easy to configure, but I just caot find a solution online. Now if I press Up/Down key in the terminal prompt, previous command will come up (incremental history search). This is very helpful. If I can press a short-cut, then press Up/Down key to navigate the cursor on the screen, that will be perfect!

I hope I made my question clear, and someone can give any hint!