wow thats not as had as I thought it was going to be for a a noob in head-modeling.
good efford.

The edge loops you have going on need to carry on around the head alot more and you need to shape the face details alittle more.

Check out the tuts on here about face looping and you should be fine

I`m not liking the ear though.
What i do is

get a image of an ear
"create polygon" tool around the shape,
then "spit polygon" in the edges of each part.
then Excrude or pull/push the details in to shape.
Attach to head.
I would make a human ear frist then deform it after to an elf like one.