CAcert Code Development list.

[gstark <gstark AT cacert.org>]

I had a breif discussion with Philipp Dunkle about setting up a second test
system.  Then having Solomon Chang assist with configuring a replication
and backup scheme.  This could include what ever monitoring and alarm
tools.

This would would allow us to 1) allow use to experiment, 2)gain experience
in such a configurations, 2) it could then be used to train the
Crit-Systems people to manage such a configuration

What is test1 ? Is it a virtual machine? ....

Would that be a diseriable?

For software development purposes, wouldn't it be helpful and possible to
create some Live-CD or VM image, complete with a test data set for people
to hack on.  There seems to be a lot of Fear, Uncertainty, and Doubt (FUD)
about developing this package.  Seems it just needs some getting started
documentation and a diagram or two.  I see the tables are beginning to be
commented.

Regards,
Greg

On Thu, 09 Jul 2009 15:33:53 +0200, Markus Warg 
<cacert AT quarkus.de>
 wrote:
> Hi,
> I had to configure and maintain a set of several mysql servers over the
> last 8-10 years for our customers. Range from simply home use data store
> to full grown several GB sized customer database with replications.
> 
> Yet, I'm neither an fulltime DBA nor fulltime system administrator.
> 
> If you'd appreciate it, I would offer to help with the performance
> problems.
> 
> For monitoring I'd suggest a combination of nagios remote and NRPE
> checks. Having installed some plugins nagios is able to monitor, send
> warnings and notifications (hint hint - even for more productive or
> testing servers, if such thing is not already in place for CACert - hint
> hint) and store performance data which gets displayed by rrdtool.
> Many thinks come out of the box and many more things can be plugged into
> nagios if needed with quite reasonable effort.
> 
> regards,
> 
> Markus
> 
> 
> Henrik Heigl schrieb:
>> Greg,
>>> The point of my inquirers and effort is to determine and fix the poor
>>> performance of the MySQL database. Then talk to this group here about
>>> scaling, testing, secure replication and switchover.  Solomon has
>>> experience in high demand enterprise scale MySQL installations and is
>>> willing to help. 
>>>   
>> No problem. As I said "go on" ;-)
>>> What access is available to the test machine?
>>>   
>> Was that question for me? If so: i run it ;-)
>>> Greg
>>>
>>> On Wed, 01 Jul 2009 20:22:05 +0200, Henrik Heigl 
>>> <cacert AT gmx.net>
wrote:
>>>   
>>>> Hy there,
>>>>
>>>> as I can read here my services for monitoring the CAcert
>>>> Servers/services from outside including ping, Service supervising
(e.g.
>>>> Apache, mySQL, wiki, blog, diskspace, etc.) Services, etc. over a
>>>> Whatsup Gold instance from outside (and so independant System) are no
>>>> longer needed.
>>>> As of this day I will delete all the monitors and let this job (also
>>>> the Mail Alarm, etc.) up to you guys.
>>>>
>>>> Greg Stark schrieb:
>>>>     
>>>>> -----Original Message-----
>>>>> From: Solomon K. Chang 
>>>>> [mailto:skevin521 AT yahoo.com]
>>>>>  
>>>>> Sent: Tuesday, June 30, 2009 5:45 PM
>>>>> To: Greg Stark
>>>>> Cc: 'Wytze van der Raay'
>>>>> Subject: Re: CAcert - Monitoring
>>>>>
>>>>> For monitoring, I definitely recommend Zabbix.  It's easy to set up,
>>>>> and
>>>>> if
>>>>> you have an SMTP server on the same network, you can have it email
you
>>>>> alerts if anything exceeds a certain threshold.  Everything is also
>>>>> stored
>>>>> as historical data, so if you want want to watch things like CPU and
>>>>> memory
>>>>> usage over the course of the day/week (usually to see when your peak
>>>>> hours
>>>>> are), you can do so easily.  Almost anything that you can capture a
>>>>> number
>>>>> for, you can render as a graph.
>>>>>
>>>>> As for schema, well, it doesn't look like you're too buried in data
>>>>> yet.
>>>>> Yeah, "locations" is big, so for starters, if this table requires
>>>>> concurrent
>>>>> access, change the storage engine to InnoDB.  You might want to
>>>>> consider
>>>>> it for your users table too.
>>>>>
>>>>> "notary" has redundant indexes, "from_2" and "to_2".
>>>>>
>>>>> Do you have your Slow Log set?  I like to keep mine at 1 second. 
>>>>> Especially
>>>>> for a user heavy database.  Any query that takes up more than a
single
>>>>> second to run is way too much, unless you're doing BI, which should
>>>>> only
>>>>> take place on a slave that has nothing to do with production.
>>>>>
>>>>> If either of you have a specific question, please, ask away.
>>>>>
>>>>> Solomon Chang
>>>>>
>>>>> --- On Thu, 6/25/09, Greg Stark 
>>>>> <gstark AT cacert.org>
>>>>>  wrote:
>>>>>       
>>>>>> From: Greg Stark 
>>>>>> <gstark AT cacert.org>
>>>>>> Subject: CAcert - Monitoring
>>>>>> To: "'Solomon K. Chang'" 
>>>>>> <skevin521 AT yahoo.com>
>>>>>> Cc: "'Wytze van der Raay'" 
>>>>>> <wytze AT cacert.org>
>>>>>> Date: Thursday, June 25, 2009, 9:11 PM
>>>>>> Solomon,
>>>>>> I don't think we have a MySQL DBA. Hence my contacting you.
>>>>>> In your response, you mention:
>>>>>>
>>>>>>         
>>>>>>> Get a good monitoring package, but every sysadmin
>>>>>>> already knows that.
>>>>>>     
>>>>>>         
>>>>>>> You'll want to set alerts on CPU usage of the mysql process, number
>>>>>>> of tables open, number of current deadlocked queries, etc.
>>>>>>>           
>>>>>> What would you recommend for a monitoring tool(s)?
>>>>>>
>>>>>> You may find quicker answers to questions if I step out of the
middle
>>>>>>         
>>> and
>>>   
>>>>>> talk directly to Wytze van der 
>>>>>> Raay<wytze AT cacert.org>.
>>>>>>  There are
some
>>>>>> questions I think you have great expertise, about live updating of
>>>>>> two
>>>>>>         
>>> or
>>>   
>>>>>> more MySQL DBs switching between the them, and backups.  Send him
>>>>>> your
>>>>>> presentation handouts you had at CalTech - SGVLUG would be
>>>>>> helpful.  Scaling needs?  Wytze may be able to tell you more.
>>>>>>
>>>>>> The web server runs mysql-server-5.0 (version 5.0.32-7etch).
>>>>>> The current table layout of the database can be obtained
>>>>>> through
>>>>>> the regular web interface at http://www.cacert.org/sqldump.php
>>>>>>
>>>>>> Oh, there is also the https://lists.cacert.org/wws/lists and ;
>>>>>> cacert-devel AT lists.cacert.org
>>>>>>  
>>>>>> CAcert Code Development list to monitor.
>>>>>>
>>>>>> Regards,
>>>>>> Greg
>>>>>>         
>> -- 
>> 
>> mit freundlichen Grüßen / best regards
>> Henrik Heigl - CAcert Public Relations Officer & Initial Organisations
>> Assurer
>> 
>> CAcert.org - Free Certificates
>> E-Mail: 
>> PRO AT cacert.org
>>  & 
>> Henrik AT CAcert.org
>> 
>> PGP Key ID: 0x47471A1B
>> PGP Key Fingerprint = 3BB331E833B16FE0E655FF6AF3EC0C9147471A1B
>> 
>> 
>> pub 1024D/A602F58D 24.04.2006 CAcert 
>> <cacert AT gmx.net>
>> Primary key fingerprint:  5930 DFDB 69C5 731D 3487 3FD6 C231 6883 A602
>> F58D