Preheat the oven to 400°F (204°C).
In a large skillet, heat the olive oil over medium-high heat.
Season the chicken thighs with salt and pepper on both sides and add them to the skillet skin-side down.
Cook for 5 to 6 minutes or until the skin is golden brown and crispy.
Flip the chicken over and cook for an additional 2 to 3 minutes. Remove the chicken from the skillet and set it aside on a plate.
Add the butter to the same skillet and melt over medium-high heat.
Add the baby potatoes to the same skillet and cook for 5 to 6 minutes or until they are lightly browned.
Add the garlic, rosemary, thyme, and lemon slices to the skillet and stir to combine. Season the potatoes with salt and pepper.
Return the chicken to the skillet, placing it on top of the potatoes and lemon slices.
Transfer the skillet to the preheated oven and bake uncovered for 25 to 30 minutes or until the chicken is cooked through and the potatoes are tender.
Remove the skillet from the oven and let it cool for a few minutes.
Serve the chicken and potatoes hot, garnished with additional fresh herbs and lemon wedges if desired.