Building a email communication system

hi,
the website i work for is looking to build a email system that can handle a fair few emails (up to a hundred thousand a day).

These comprise emails like registration emails, newsletters, lots of user triggered emails and overnight emails.

At present we queue them in SQL and feed them into an smtp server on one of our web servers when the queue drops below a certain level.

this has caused our mail system to crash as well as hammer our DB server (shared!!!).

We have got an architecture of what we want to build but thought there might be something we could buy off the shelf that allowed us to keep templated emails, lists of recipients, schedule sends etc and report on it. We can't find anything

What do big websites like amazon etc use or people a little smaller but who still send loads of mail (flickr, ebuyer, or other ecommerce sites)

Cheers

tarqs

Todd Hoff's picture

Re: Building a email communication system

There was a good Ycombinator thread on this a while back: http://news.ycombinator.com/item?id=92022.

Re: Building a email communication system

There are dozens of ESPs that can help with that. For the volume you're talking about you'll need to talk to a tier-1 player like Silverpop or YesMail! Both have good APIs for sending templated messages, transactional messages etc.

For 100% in house look at StrongMail. If your issue is the outbound MTA, look at Port25's PMTA product.

Hope this helps,

Chris

Todd Hoff's picture

Re: Building a email communication system

Here's a suggestion from http://developer.amazonwebservices.com/connect/message.jspa?messageID=76...

I use authsmtp and I'm very happy with the service. I use postfix locally, configured to send all mail through the gateway so that the mail is sent more quickly from my web app.

http://authsmtp.com/

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd><div ?=?><p ?=?> <img ?=?><h1 ?=?><h2 ?=?><h3 ?=?>
  • Lines and paragraphs break automatically.
  • Glossary terms will be automatically marked with links to their descriptions
  • You may link to webpages through the weblinks registry

More information about formatting options

To combat spam, please enter the code in the image.