Booki.sh have just announced they’ll be launching an ebook store in Australia, where the books are not downloaded but streamed from the cloud.

With the implication that we’re only renting/licensing our purchases, this news has caused quite a bit of a stir with some people denouncing it as, the worst thing to happen to publishing. Of course, some people would say that DRM has already killed off any possibility of actually owning our ebooks, including Booki.sh themselves.

This “ebooks-in-the-cloud” scenario isn’t new. I’ve been mulling it over for a while and my conclusion is that it’s not such a bad idea – but only if the book industry change the way we pay for them.

If all our books are stored in the cloud – meaning that we can’t download them to external storage – then we really are only renting them. I don’t find this such a big deal because if I actually wanted to own a book, I’d probably go out and buy a paper version anyway (wow, did I just say that).

(Ok, so that’s no completely true, but most of the ebooks I do buy are DRM-free professional books, from O’Reilly, A Book Apart, etc., so I do actually own them.)

It’s only recently that I’ve come to realise (or is that admitted to myself) that I mostly only read books (novels) once and if I ever read them again, it’s likely years after the first time, so I don’t mind having one-off/temporary access to them. But, if these cloud books imply that we’re only renting them, then I’d expect the price to be reflected in that.

The business model for ‘ebook Rental’ could be something similar to what we have with DVD rentals, where you can get pay-per-view movies streamed over the internet for anything from 25% – 50% of the purchase price. If I take a monthly subscription package then I could get them even cheaper.

So publishers, are you going to let me rent my ebooks – will you let me read Stieg Larsson for $2.00?

…no, I didn’t think so.

In a recent ZDNET article, Jason Perlow described his hesitations for buying one of the new Amazon Kindle’s, which was due to its lack of EPUB support. Many responses to the article noted that the “average user” doesn’t care about the format of an eBook, only for the buying experience. I’m not going to argue on that point because in essence, they are right; the average user doesn’t care. Yet there are two real reasons why having one eBook standard is important, and these reasons will certainly impact the end user.

Publishing Infrastructure and Costs

Although most publishers will use a XML Master Format for storing the original book content, they still have to spend a lot of time, effort and costs in producing and maintaining all the different output formats they need to get their books in to the buyer’s hands. There are also no guarantees that all these different output formats will support the same kinds of features, which will mean even more resources (costs) will be needed to support these alternate formats.

Now, if the publishers only had work one eBook standard then they could spend more resources on improving their own tools to produce better output, which will ultimately give the user an even more enjoyable reading experience. Publisher will also have more resources available to give input back to the IDPF on improving the EPUB standard; bringing more and better features to the eBook world. Certainly a win-win situation for consumers and publishers. Without universal support for EPUB though, everyone will be forced to maintain multiple tool sets, which do nothing but increase costs.

I won’t bring DRM in to this conversation as it is actually independent to the eBook format itself and should not be used as an argument against embracing EPUB.

Independent Authors

One important issue Jason brought up in his ZDNet article was that of self publishing authors. By giving independent authors just one eBook format to think about they are able to spend less time producing eBooks files and more time writing content. They’ll have fewer headaches in getting their books out to the public because all vendors will accept EPUB. With just one eBook standard, more and more EPUB-ready word processors and tools will be developed. The more authors that get content on to Amazon’s self publishing system, the more money Amazon will make. Isn’t this what Amazon wants?

Until just a couple of years ago the publishing world was in turmoil with a multitude of eBook formats it had to support, yet the arrival of EPUB had a hugely positive impact which continues to be seen today.

Sure, EPUB itself is not perfect, but it is being continually improved and with the formation of the EPUB Working Group, there are huge improvements being made right now.

I still can’t make up my mind if Amazon will ever support EPUB but I do believe that it will be more and more difficult for them to refuse to do so. Let’s hope it’s sooner rather than later.

The private education sector in the UK is being forced to become more competitive in  the current economic climate. We are not talking about the Etons and Harrows who will always have waiting lists but the lesser know schools which take in pupils with average ability and learning difficulties with the aim to have them leave with the best exam results possible.  This is the sector that needs to attract more pupils.

So how do you attract more pupils? One of the key ways is to use Value Added Scores which compare the pupil’s ability when they enter the school to that of when they leave. If a school is taking pupils with predicted C or D grades at GCSE and sending them out with A or B grades then that school becomes an attractive proposition for parents. The problem is how to achieve such a rise in grades.

One of the best methods is to offer more courses that cater to a pupil’s strengths. However this does lead to the problems of providing staff to teach them and a classroom to teach them in. The staff problem is relatively easy to overcome as most good teachers can teach most subjects to GCSE level.

The second problem of where to teach them is a challenging one. No school achieves one hundred percent utilization of their classrooms. At the same time no teacher wants to carry around all the textbooks required to teach their course around with them all day. So it would seem that the obvious answer is to give the pupils the textbooks so they can take them from lesson to lesson. The problem is of course that some pupils will forget them, causing the inevitable disruption to the start of the lesson as pupils are moved around so they can share. The other problem is the amount of weight a pupil would need to carry around with them.

So this leads to the proposition of using eBooks. This, along with the use of interactive whiteboards, makes the course mobile and so no longer tied to the room with textbooks in. This allows the school to better utilize the spare classrooms in any given period and therefore able to provide more courses for their pupils. This means that the school is able to target more suitable courses to a pupil.

From a pupils point of view they are unlikely to forget something that is required for every lesson. If they do then it would be possible to lend a pupil a spare device from the school’s library or boarding house and load it with the textbooks required for the day.

So, the use of eBooks could provide a practical solution to a private schools dilemma of having to offer more courses directed towards the “average” pupil to help them achieve better Value Added Scores without the need of more classrooms. Schools which are early adopters of this new technology also benefit from the added marketing value as being seen as innovative and “hi-tech”.

So it’s win-win for the eBook then? Well not quite, there are several issues which need to be overcome with eBooks, not least of which is the cost of the devices and licensing of books. I will discuss these issues in future articles.

[Andy is an IT professional within the British education system and has agreed to share his thoughts on how eBooks can benefit schools.  -- Mike Cook]

A few days ago I had the pleasure of being invited up to Stockholm to sit with a bunch of like minded people and talk about eBooks – specifically the ePub format. This was a very eye-opening experience indeed.

I was invited to Sweden by Publit, a company who have set themselves the task of making all the Swedish out-of-print books available as PoD (Print on Demand) titles. Considering that 95% of all Swedish books ever in existence are now out of print, this is a very worthy project, if perhaps somewhat daunting. Although Publit’s main business is PoD, they are making use of this opportunity to also provide these titles as ePub eBooks.

During my time in Sweden we discussed the many different areas of the eBook world, including DRM (of course), the processes involved in going from scanned document (TIFF/PDF/DOC) to an eBook Master format and onto ePub creation itself.

Now, the people at Publit are a group of very talented individuals with plenty of technical knowledge, yet there were aspects of ePub which has left them somewhat perplexed. There were two main points which I found interesting and have heard before around the web so I thought I would share them here.

“What flavours of ePub exist?” There is only one flavour of ePub, although it does currently support two different core formats; XHTML and DTBook (Daisy Talking Book). I won’t go further into what makes an ePub here as Jon Noring has already written an excellent article over at Teleread.org; ePub Demystified.

They were also asking if I thought “the next release of ePub would have more advanced features?” (meaning video and Flash media). The answer to this question is that video and Flash, along with audio, are already possible.

The ePub standard (OPS) can already use these types of media because the standard is built upon XHTML, a standard that already supports advanced media. The problem arises not from ePub but from the reading systems’ ability to render these advanced features.

ePub can do more than most people think; the main restriction is the reading system not the format.

I guess the question should be, when will the reading systems allow us to use more advanced media.

We also had a number of discussions on Master Formats (TEI, DTBook, DocBook, etc.) and which is the best to go for. That’s a difficult question but one thing that ties in with my recent thoughts is the question as to whether we can use the native DTBook format not only as the end user ePub format, but also as the eBook master. I will be looking into this further myself but if anyone has any thoughts on the use of DTBook then please share.

While all the U.S. publishers/eBook stores remain reluctant to embrace the ePub format, the UK, and Europe in general, is really forging forward with its adoption. The latest to release an eBook store selling ePub books (plus PDF and other popular formats), is the UK academic publisher, Blackwell.

In addition to the 45,000 titles they have launched with (in partnership with the eBook wholesaler Gardners), Blackwell will also be stocking the BeBook eReader, a reader which is becoming quite popular among UK users.

It’s uncertain as to whether they will use any DRM (I can’t imagine they won’t) but at the moment the BeBook does not suopport the Adobe (ePub/PDF) DRM. However, there was a recent annoucment from Endless Ideas, who sell the BeBook, that their new WiFi BeBook reader will be supporting ePub DRM. Perhaps there will soon be a firmware update for the current model.

After several months of development my new epubBooks.com website is live. The new site has been developed to give access to free EPUB book downloads and I’ve designed it with simplicity of use in mind – hopefully it’s visually pleasing too.

All the current downloads have been produced from public domain titles using my own automation tools (with a little help from Liza Daly). These tools have been developed to give features which are often only found in commercial eBooks, and even then, many of the classics available don’t have such features.

All footnotes are fully linkable (as endnotes at the back of the book) both to the note itself and then back to the page it was linked from. Illustrations are included for books where they were available. Many other advanced layout and formatting features have been included, which are often only available with handmade books.

At present the library of books is quite small, but from now I will be concentrating on converting new books and improving the speed at which I can convert them.

Over the last year or so I’ve seen forums and blogs asking why there are not that many books which have illustrations, and so this was one area I wanted to concentrate on. It should be noted that illustrated ebooks are quite tricky to convert automatically, so the numbers of new titles being added is going to be limited, however, I’ll work to try and improve in this area.

If you have comments on the new website or the EPUB ebooks that I provide, then please do contact me. I’d love to hear from you.

While developing the new site I’ve neglected the Blog terribly so I am going to make much more of an effort to update this with any EPUB relevant news on a more regular basis.

I hope you enjoy the new website — Mike.

This last week has proved to be quite a week for the EPUB eBook format with announcements from Google, Sony and Project Gutenberg on their support for the EPUB format.

Project Gutenberg EPUB Books

Over at Project Gutenberg, Marcello Perathoner has been working hard to convert all the Gutenberg titles into the EPUB format. At this time these versions should be considered experimental, but after trying several different titles, they are all more than readable.

The books are converted where possible from the HTML version in the Gutenberg archives and for those titles without a HTML version, Marcello uses the plain .txt book. The plain .txt files at Gutenberg are notoriously inconsistent in their layout so converting these accurately is extremely difficult — I know this myself only too well. Perhaps it’s time Project Gutenberg embraced a Master Format.

What makes this special from the other news (see below) is that all the Gutenberg books go through a proofreading process and so the accuracy is very high. This is why so many other eBook project are based on the Gutenberg archives.

Google and Sony partner to release 500,000 Public Domain EPUB Books

Over the last few years Google has been scanning bo0ks by the million, making them available on their book search, but this is the first time they have any of them available to an eBook reader. All the titles are in the public domain (pre-1923 titles only) and once added to the current Sony Reader catalogue, brings the total available titles to around 600,000, far surpassing Amazon Kindle’s 240,000 catalogue. Amazon still use their own propriety eBook format and do no currently allow EPUB files to be read natively – conversion is needed first – but as the Google EPUB books all come DRM free, there are many tools out there that will allow you access to these on a Kindle or other reading platform.

As the press release states, “the publishing industry has more or less united on EPUB for e-book distribution”, so c’mon Amazon, let’s see some native EPUB support!

Don’t have a Sony Reader?

Although this announcement is aimed at Sony Reader owners, you don’t need to own a PRS-505 or PRS-700 to read these Google EPUB books. Just download the Sony “eBook Library” software to search and download. Paul Biba’s article over at TeleRead shows how to access the books without owning a Reader.

No access for non-U.S. based PRS-505 owners

Yet again, this is a U.S. only release, at least if you already own a PRS-505. You can only access the Google books via Sony’s “eBook Library” software, but in my UK version we don’t have access to the Sony Book Store as we are only pointed to the Waterstone website. When I tried to install the new version (2.5) it tells me it cannot install in my region! I believe it is because I already have my UK reader registered and if I were to install on a second computer I would then have access to these titles.

If there are any non U.S. PRS-505 users out there who have succeeded in accessing the archive, please let me know.

Google EPUB Quality?

As Google does not proof read their scanned books, relying completely on the OCR (Optical Character Recognition) software to produced the digital characters, the quality of the text themselves is not as good as archives like Project Gutenberg or websites that take their books from PG, such as Feedbooks.com. Then again, were are getting 500K free books with the potential to access another million Google books in the future.

All in all, this has been a good week for the EPUB format.

Over the last few weeks several people have emailed asking if epubBooks.com has been abandoned – the answer is a resounding No! Okay, I know I’ve not been very active recently so please accept my apologies for that.

The reason for such limited activity is that I am working very hard on developing the new site for epubbooks.com – yes, the blog and current resources will still be accessible. The new site will allow you to download all kinds of different EPUB books, including many from the Project Gutenberg archives.

If you don’t know what my ePub Books Project is, here is a short summary.

The project was started to provide free downloads of nicely formatted EPUB files, the majority of which will be taken from the Project Gutenberg archives. These will not just be plain TEXT files enclosed in an EPUB container, but fully converted to XML (of a TEI flavour) which are themselves converted using XSLT into professional quality EPUB files. Here are some of the features;

• Properly formatted and displayed Chapter Titles/Subtitles.
• Footnotes which are Linkable (forward and backward) for instant access
• Books with Illustrations will also be available.
• Text Formatting (italics, etc.)
• Nice indents for block quotes, letters of correspondence, epigraphs, etc.
• …and many more features

The new web application is the biggest project I’ve developed to date and so is naturally a challenge to my programming skills, which is why it’s taking some time to complete, however things are going very well.

The basic skeleton of the site up and running and I am now working on programming for usability. Of course it’s these less obvious items which are some of the hardest things to programme, so at this time can’t give an accurate launch date. Rest assured it will be sooner rather than later.

Thanks for your patience and understanding and do keep checking back regularly for any new updates.

I Twittered (@epub) about the Cleveland Public Library press release when it was first announced, and David from TeleRead has also written a post on this. “This” being that the Cleveland library is the first library to offer up eBook downloads in the EPUB format! Naturally this is great news for the EPUB fans, but more importantly it’s great for the general public at large.

OverDrive are providing them and another 8,500 libraries access to EPUB books for borrowing. We must also presume that as OverDrive increase their number of EPUB titles , all these libraries will be offered them too.

As TeleRead mentions, it would be great if they could also offer their books via popular iPhone readers such as Stanza which could then encourage younger readers to get back to books.

I expect 8,500 libraries is a good coverage across the U.S. but as an European I hope our libraries can strike a similiar deal. If both sides of the big pond can offer up these services then there’s potential for more countries to follow suit, which would be particularly useful for those where moving a ton of paper books around can be quite difficult and expensive.

During 2008 the EPUB eBook format gained huge acceptance and we heard rumours touting that there would be 20,000 available EPUB titles by the end of the year. Waterstones were saying this prior to the release of the Sony Reader in the UK.

As we head into 2009, Waterstones still shows less than 7000 titles in their catalogue, when viewing all available eBook titles. However, I get the feeling that this will change quite soon.

A few days back BooksOnBoard made an announcement on WebWire that they now have 30,000 titles available for the iPhone. After doing a search on their site I found that almost 20,000 of those are in the EPUB format. Great news for ePub fans, but we need more. Still, BooksOnBoard was the first retailer to make commercial ePub formatted books available and their entire online eBook collection consists of almost 300,000 titles. Perhaps they will be the first to reach 100,000 ePub books!

No doubt other online retailers such as Waterstones will be soon following suit – will 2009 be the year of the EPUB format?

Below is an example <pageList> markup (that is valid per the NCX DTD) which can be used to mark up page numbers within ePub documents.

Note that <pageList> must be placed right after the required <navMap>, and must occur before the first optional <navList>. There may be one and only one <pageList> (but there can be any number of <navList> — of course, there can only be one <navMap>).

<pageList id="page-mapping">

  <navLabel><text>Paper Edition Page Mapping</text></navLabel>

  <pageTarget id="page-iii" value="3" type="front" playOrder="82">
    <navLabel><text>Page iii</text></navLabel>
    <content src="frontmatter.html#pageiii"/>
  </pageTarget>

  <!-- ... -->

  <pageTarget id="page-105" value="105" type="normal" playOrder="192">
    <navLabel><text>Page 105</text></navLabel>
    <content src="chap5.html#page105"/>
  </pageTarget>

</pageList>

Notes:

1. Currently there is an error in epubcheck 1.0.3 which says <pageList> must include both the id and class attributes, while they should be optional. Hopefully that bug will get fixed. The above markup includes the optional id (generally a good idea), but not the class so it will not validate to 1.0.3.

2. On <pageTarget>, the type attribute is required and takes one of three values: front, normal, or special. I interpret front to mean front-matter, normal to mean ordinary body matter, and special to mean back matter or some other special section which is not front or body matter.

3. On <pageTarget>, the value attribute is optional and I interpret it to contain an integer number expressing the page value associated with the given type. a type:value pair must be unique in the NCX, which cannot be checked by XML validation. [Note that playOrder is required.]

4. Based on figuring out how this would work in the authoring and reading system environments, it is highly recommended that the target fragment identifier for the “new page” NOT point to an existing id associated with some document structure, but should point to an id specifically associated with the beginning of a new page.

This means adding id to either an existing element marking the beginning of a new page which does not already have an id, or adding a <span class=”newpage” id=”pagexxx”></span> or <div class=”newpage” id=”pagexxx”></div> as needed to pinpoint the location of the start of a new page and its value.

Note that in my example above, I added special id values of pageiii and page105 to the content, and not used id values associated with some document structure (such as header, paragraph, etc.)

[Editors Note: Thanks to Jon Noring for writing the above article.

I would like to add that although the above method IS valid against the NCX DTD, marking up pages numbers in this way has not yet been officially approved by the IDPF. It must also be noted that there are yet no reading systems that would utilize this information.

This method is now being discussed in the EPUB Working Group. If it does become part of the official specification, then it should not be a burden on reading system developers since the syntax for <navList> and <pageList> is the same as that for <navMap>.]

Back in September I wrote about my epubBooks development; a project to convert the .TXT ebooks from Project Gutenberg into the IDPF’s EPUB format. After many months of hard work I’e finally finished the conversion tools and I’m now preparing development of the website itself, which will allow anyone to download my EPUB books, and all for free.

Although I’m happy with the current formatting in the EPUB files, I wanted to turn to you, the ebook community and ask for your feedback, in the hope that the improvements you submit will make these EPUB ebooks even better.

EPUB Book Features

• Linked Footnotes – each footnote number is a link, click on this to see the footnote (I’ve actually made them all endnotes). Clicking on the notes number takes you back to the original page.
• Images – Some titles will include images.
• Nicely formatted titles, subtitles, etc.
• Paragraph indents – Except on first paragraph of a chapter/section – as is usual in paper books
• Block Indents – Small left/right indents on block quotes, letters of correspondence, songs, etc.

This is just a small selection for some of the formatting features I’ve implemented.

Please Note: As certain systems enforce their own stlying by defaults, various features will display differently. UPDATE (2011): This isn’t as prolific as it used to be.

Test the EPUB

The title I’m making available as a pre-release download is Gulliver’s Travels by Jonathan Swift – this has many features which show off my conversion. As this eBook contains images it is quite large, weighing in at over 5MB.

The test book has now been removed as you can find the final release here;

Gulliver’s Travels (Final)

All comments, on both the frontend formatting (indents, italics, etc) and the underlying code (OPF, NCX, HTML markup) is very much appreciated.

This ebook can be read using Adobe Digital Editions, Stanza (desktop and iPhone version), Sony Reader (PRS-505 and PRS-700), BeBook and the FBReader.

Enjoy!

EPUB formatted books as an industry wide standard is what I, and many others want. But can we achieve this without Amazon’s adoption — at least with ePub support on their Kindle eBook reader.

It will certainly be a lot easier to have a standard eBook format if Amazon joined the ePub party. I’m reluctant to say it but all current indications show that Amazon will not adopt the ePub format in the near future – but perhaps there is hope.

Recently we have seen a flurry of publishers and eBook projects (including yours truly) adopting the ePub format and a number of these are pushing their titles onto the iPhone/iPod Touch platform via the Stanza eBook reader. Feedbooks, Project Gutenberg are the two big projects but we now have Pan Macmillan offering commercial Tasters and in the last few days BookGlutton announced that they have joined forces with Stanza. Interesting times ahead for sure.

With all this recent iPhone/eBook activity I am asking myself, where is Amazon? The Kindle is certainly making waves with big sale numbers but this is probably nothing compared to iPhone sales. This makes me wonder if Amazon will start making their titles available on this platform and if so, what format will they use. If they use their own eBook format (AZW), they would need to release a dedicated ‘Amazon eBook Reader’ — how many different iPhone reader applications will people accept?

Everyone around here knows that having one standard eBook format will better serve everyone. If Amazon opens their Kindle to the ePub format and strikes a deal with a company such as Lexcycle (Stanza) they could kill two birds with one stone. Hmm, perhaps an Amazon/Stranza union is a little too much wishful thinking.

Providing direct purchase and download would make Amazon a serious option for any iPhone or iPod Touch user, and vise versa.

So, can Amazon leverage the iPhone to further dominate the eBook market and can they continue to resist the ePub eBook format?

Disclaimer: The Amazon/ePub logo I created is intended just for fun.

During the Digital Lunch seminar at this years Frankfurt Book Fair, Michael Vantusko from Overdrive commented that W.H.Smith was one of their eBook customers. As I was updating the epubbooks.com homepage I thought I’d check them out to see if they actually have them online yet. I don’t know the date W.H.Smith went live with their ePub books but they currently have almost 6,500 ePub titles.

As Overdrive also distribute to Waterstones I would imagine that the W.H.Smith eBook collection will grow quite quickly. It’s great to see more stores offering ePub formatted books to the consumers – perhaps this extra competition will result in lower eBook prices sooner rather than later.

There is however quite some way to go before the number of ePub titles reaches the overall eBook numbers. Here’s a quick breakdown of the current eBook titles in the W.H.Smith eBook store;

56056 - PDF
15368 - MobiPocket
6441 - ePub

I also found it interesting that they’re offering eBooks in languages other than just English. Here’s a breakdown of those in the ePub format, which I will follow up with total eBooks in any particular language.

5863 - English ePub Books
509 - French
50 - German
9 - Spanish
6 - Italian
2 - Swedish
1 - Finnish
1 - Norwegian

A selection of different languages in all eBook formats found on the website;

60586 - English (All eBook Formats)
946 - Spanish eBooks
885 - Japanese eBooks
801 - French eBook
424 - Italian eBooks
390 - German eBooks
35 - Dutch eBooks
26 - Russian eBooks
19 - Chinese eBooks
14 - Portuguese eBooks

Liza Daly from threepress.org has just released an article outlining problems she is having with users uploading invalid ePub formatted documents to Bookworm; an online ePub book reader. It’s very important for anyone developing ePub eBooks to produce valid markup. Not only will Bookworm give desirable results when rendering, but you’ll also be covering yourself for any future rendering engines and conversions you might need to do.

It’s actually quite surprising how many errors are showing up from files submitted to Bookworm. You should go over to the threepress blog for a full explanation, but here’s a list of the main errors;

1. Missing required attributes in the metadata
2. Metadata that hasn’t been proofread
3. Improper nesting of the ePub zip file
4. Items declared in the OPF file that are missing from the archive
5. Invalid XHTML

Points 1 to 4 are really quite vital, although it is understanable for many documents to have invalid XHTML. Still, if it is within your means, I would try to control this the best you can.

I have plans to write some detailed articles regarding the creation of both the NCX and OPF files found in an ePub document, so keep a lookout for those.