Most people flock towards Wordpress, and that would usually be my default, but if you're not doing mass amounts of customizations, its not the best solution. Wordpress is a DIY framework, you still have to handle a lot of the upkeep yourself. There's the endless search for a theme, finding the right plugins, customizing everything so it works just right. It's not exactly plug-and-play, it becomes very bloated and not fun to use. I do, however, think its a great platform for building bigger, more complex websites. It's just overkill for what I was wanting and looking for, and I was looking for a lighter-weight solution that still got the job done.
On the other end of the spectrum, there's Tumblr. They make it really quick and easy to set up a blog and have it up and running in no time. It's also free, which is a big draw for most people starting out. Tumblr lacks a lot of features though, and for the most part, through no fault of their own, Tumblr is known for being the place where you post GIFs of last nights episode of the Tonight Show. It doesn't really shine as a professional blogging platform.
Lastly, there's Squarespace. Squarespace is relatively new in the CMS/blogging world, only becoming well known in the past couple years. The ease of setting up a Squarespace site beats that of Tumblr, and while its feature set and ability to customize is not going to compete with Wordpress, for most people its pretty darn good. I had this site up and running the exact way I wanted it to look and feel within a couple days, probably only taking a few hours to get all the custom CSS in and working. The ease of the drag and drop interface is genius, and there are tons of incredibly well designed templates that are developed specifically for Squarespace. This site is run of the Native theme.
In my mind, there is no competition. I pay $8 a month, get a complete, fully functioning site, without the hassle of dealing with hosting or any of the back-end development, and by default if looks incredible. I get full analytics, the ability to add a store in the future, customized blocks, etc. I could go on and on. If you're thinking of starting a blog or a portfolio, the first place you should look at is Squarespace.
Also, I'm not getting paid to write this post. I just think it's that good.