For CPU is easy, you only need to adjust vcore voltage and core speed.
Try 1.3v and 4.8 GHz first, and play around. Use prime95 to check overclocking stability. Make sure temp under load is less than 85 degree.
If not stable, either decrease clock speed or increase voltage. I recommend not exceeding 1.35v at first. What cooler do you have?
This is my default setup:
Then I enabled Game Boost and changed CPU BASE CLOCK to 104.77 MHz, in order to achieve 4.4 GHz (as stated in the top orange bar in this shot). Everything else left to AUTO.
Rebooted, and, as you can see, I reached only 3.77 GHz. What am I missing??