How to create a HTML Template

Hi, I am new creating a web page and I am not sure if I am in the right direction.  I need your help experts!

I would like to design a web page that will have a logo and a menu on the left.
Using <div> I have create a "container" that has different sections (<div>)  like "header", "sidebar","mainContent".

something like
div id="container"  >
  <div id="header">
    <img src="logo.GIF"alt="logo" />
  </div>

<div id="sidebar">
    <ul id="menu">
       <li id="active"><a href="option1.html" id="current"> option1 </a></li>
       <li <a href="option2.html" > option2 </a></li>
       <li <a href="option3.html" > option2 </a></li>
   </ul>
  </div>
  <div id="mainContent">
     .....................
 </div>
(I have a css file to control the setting of each element in the html and I am going to use jsp language to run the business part)

Every option (each html file) will ask for a  particular form that I will show on the mainContent div section. Every time I select an option I will get the right form.

 I was reading that I can use a dwt file to create a template that will have all the non-editable regions but I dont have dreamweaver license. Is there any other way to create a template so if I change something in the template, this change will appear in multiple pages (option1.html , option2.html, option3.html) automatically,

thanks in advance