<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style></head>
<body class='hmmessage'><div dir='ltr'>I think the xml is well formed.<div>It's dropping entire node sets: <page></page> <div><br></div><div><br><div><hr id="stopSpelling">Date: Thu, 6 Feb 2014 11:45:57 +0000<br>From: xerte@pgogywebstuff.com<br>To: xerte-dev@lists.nottingham.ac.uk<br>Subject: [Xerte-dev] Re: Lost Data<br><br><div dir="ltr">the thing is xml proofing it<div><br></div><div>don't save if XML poorly</div><div>don't publish if XML poorly</div><div><br></div><div>Could the editor not verify XML before firing the save?</div></div>
<div class="ecxgmail_extra"><br><br><div class="ecxgmail_quote">On Thu, Feb 6, 2014 at 10:49 AM, Julian Tenney <span dir="ltr"><<a href="mailto:Julian.Tenney@nottingham.ac.uk" target="_blank">Julian.Tenney@nottingham.ac.uk</a>></span> wrote:<br>
<blockquote class="ecxgmail_quote" style="border-left:1px #ccc solid;padding-left:1ex;"><div lang="EN-GB"><div><p class="ecxMsoNormal"><span style="color:#1f497d;">I’m also wary of suggesting we might have a problem that we might not actually have! Most users aren’t doing any funky html stuff, so I don’t think most users are at risk, if there is something not escaping properly. Also, most users aren’t on 2.1, which is where I think this problem might be (we’ve never seen it before 2.1) and even if we add some safety code, there will be a lot of older installs out there without it.<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;">One thing that I wonder is whether to remove the ‘do you want to publish’ dialog, because people just get in the habit of saying ‘yes’ and then over-write the data.xml with the duff preview.xml, and then you’ve got no way back: every single time lost data has cropped up, my first question is ‘did you publish the file’ and the answer every time is ‘yes’. Doh.<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><div><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm;"><p class="ecxMsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";"> <a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">xerte-dev-bounces@lists.nottingham.ac.uk</a> [mailto:<a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">xerte-dev-bounces@lists.nottingham.ac.uk</a>] <b>On Behalf Of </b>Ron Mitchell<br>
<b>Sent:</b> 06 February 2014 10:15<br><b>To:</b> 'For Xerte technical developers'<br><b>Subject:</b> [Xerte-dev] Re: Lost Data<u></u><u></u></span></p></div></div><p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">
<span style="color:#1f497d;">Yeah I know what you mean but I was thinking of then prompting users what to do when it happens. <u></u><u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;">But yes a history of edits of some kind sounds good but I can't imagine how that would work e.g. any single edit could cause the loss <u></u><u></u></span></p><p class="ecxMsoNormal">
<span style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;">So thinking out loud perhaps each time a change is made a copy of preview is also created but up to a max of say 5 then rotated. All users are briefed that if they ever notice a problem when editing/previewing to stop editing at that point and notify their sys admin with details.<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;">I wonder if before doing any work on this we need to send a message to the various mailing lists etc asking for specific details if and when it happened? Or would that cause a mis-placed concern given this is a rare occurrence?<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;">I just wish we could reproduce or had a definitive example :-(<u></u><u></u></span></p><p class="ecxMsoNormal">
<a name="14406d0bcd4b4a36__MailEndCompose" target="_blank"></a><span style="color:#1f497d;"><u></u> <u></u></span></p><div><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm;"><p class="ecxMsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";"> <a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">xerte-dev-bounces@lists.nottingham.ac.uk</a> [<a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">mailto:xerte-dev-bounces@lists.nottingham.ac.uk</a>] <b>On Behalf Of </b>Julian Tenney<br>
<b>Sent:</b> 06 February 2014 09:48<br><b>To:</b> For Xerte technical developers<br><b>Subject:</b> [Xerte-dev] Re: Lost Data<u></u><u></u></span></p></div></div><p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">
<span style="color:#1f497d;">I think you’d end up backing up the broken file. It’s not really a backup we need, it’s a history of the edits?<u></u><u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p>
<div><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm;"><p class="ecxMsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";"> <a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">xerte-dev-bounces@lists.nottingham.ac.uk</a> [<a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">mailto:xerte-dev-bounces@lists.nottingham.ac.uk</a>] <b>On Behalf Of </b>Ron Mitchell<br>
<b>Sent:</b> 05 February 2014 16:57<br><b>To:</b> 'For Xerte technical developers'<br><b>Subject:</b> [Xerte-dev] Re: Lost Data<u></u><u></u></span></p></div></div><p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">
<span style="color:#1f497d;">The problem also is that it's not 100% clear if this happens only after the change that caused the break. So even if we got hold of a restored backup it probably wouldn't help.<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;">At some point but probably not until middle of next week I'm going to see if I can automate my own local back up of the user-files folders on one or two of the Techdis installations. At the moment the backups are off-server and I don't have access. If I can automate local backups at least I can quickly get to the working xml as soon as someone reports this.<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;">Cheers<u></u><u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;">Ron<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><div><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm;"><p class="ecxMsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";"> <a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">xerte-dev-bounces@lists.nottingham.ac.uk</a> [<a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">mailto:xerte-dev-bounces@lists.nottingham.ac.uk</a>] <b>On Behalf Of </b>Julian Tenney<br>
<b>Sent:</b> 05 February 2014 16:16<br><b>To:</b> For Xerte technical developers<br><b>Subject:</b> [Xerte-dev] Re: Lost Data<u></u><u></u></span></p></div></div><p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">
<span style="color:#1f497d;">No idea. In the case here the html was all escaped in CDATA, being part of the main page text – I wrote it to do some custom stuff, which involved adding a custom button to each page to display a transcript for narration and a couple of other things. Once I’d sorted it out, I made a prototype and gave it to the author to duplicate, with a set of pages set up to duplicate so she could crack on with the content quickly. I didn’t experience any problems myself.<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span style="color:#1f497d;">I suspect in both cases, the user has limited html skills. They could easily have left a tag unclosed, or an attribute without a quote, the sort of thing that I’m (a bit) less likely to do.<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="color:#1f497d;"><u></u> <u></u></span></p><div><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm;"><p class="ecxMsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";"> <a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">xerte-dev-bounces@lists.nottingham.ac.uk</a> [<a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">mailto:xerte-dev-bounces@lists.nottingham.ac.uk</a>] <b>On Behalf Of </b>Smith, John<br>
<b>Sent:</b> 05 February 2014 16:10<br><b>To:</b> For Xerte technical developers<br><b>Subject:</b> [Xerte-dev] Re: Lost Data<u></u><u></u></span></p></div></div><p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">
<span lang="EN-US" style="color:#1f497d;">Hi,<u></u><u></u></span></p><p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;"><u></u> <u></u></span></p><div><p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;">I suspect that the custom HTML is your best link to reproducing this… something in there has probably caused the nodes not to load properly into the Flash editor and then when it was written back out those nodes were then overwritten. This is the problem with mixing XML and HTML, unless its properly wrapped in CDATA blocks. <u></u><u></u></span></p>
<p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;">Do you have any clue as to what was in the HTML?<u></u><u></u></span></p>
<p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;">Regards,<u></u><u></u></span></p><p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;"><u></u> <u></u></span></p>
<p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;">John Smith<u></u><u></u></span></p><p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;">Learning Technologist<u></u><u></u></span></p><p class="ecxMsoNormal">
<span lang="EN-US" style="color:#1f497d;">School of Health & Life Sciences<u></u><u></u></span></p><p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;">Glasgow Caledonian University<u></u><u></u></span></p></div>
<p class="ecxMsoNormal"><span lang="EN-US" style="color:#1f497d;"><u></u> <u></u></span></p><div><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm;"><p class="ecxMsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";"> <a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">xerte-dev-bounces@lists.nottingham.ac.uk</a> [<a href="mailto:xerte-dev-bounces@lists.nottingham.ac.uk" target="_blank">mailto:xerte-dev-bounces@lists.nottingham.ac.uk</a>] <b>On Behalf Of </b>Julian Tenney<br>
<b>Sent:</b> Wednesday, February 05, 2014 3:59 PM<br><b>To:</b> For Xerte technical developers (<a href="mailto:xerte-dev@lists.nottingham.ac.uk" target="_blank">xerte-dev@lists.nottingham.ac.uk</a>)<br><b>Subject:</b> [Xerte-dev] Lost Data<u></u><u></u></span></p>
</div></div><p class="ecxMsoNormal"><span lang="EN-US"><u></u> <u></u></span></p><p class="ecxMsoNormal">Hi,<u></u><u></u></p><p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">Just wondering if anyone else has experienced the same data loss we had here last week, and that was reported on the Xerte list yesterday. In both cases, the user reported ‘lost pages’. Looking at the xml it was intact, with a closing </learningObject> tag: that’s the first time I’ve ever seen data loss with a valid xml file left over (I would expect it to truncate at the point the file broke, and safety code should stop that then saving, right?)<u></u><u></u></p>
<p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">Maybe it’s just coincidence, but I’m a bit worried there might be a problem we don’t know about causing data to get lost. In the case reported here, I don’t suspect (highly) user error (it’s always a possibility). In the case on the Xerte list I’m less certain. I’ve asked for more info, but none has been forthcoming.<u></u><u></u></p>
<p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">Obviously we need to try and reproduce it if possible, or put in place some sort of safety mechanism. I did notice that both had some custom HTML going on in the code. Any ideas or insight?<u></u><u></u></p>
<p class="ecxMsoNormal"><u></u> <u></u></p><p class="ecxMsoNormal">Julian<u></u><u></u></p><p class="ecxMsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman","serif";"><u></u> <u></u></span></p>
This message and any attachment are intended solely for the addressee and may contain confidential information. If you have received this message in error, please send it back to me, and immediately delete it. Please do not use, copy or disclose the information contained in this message or in any attachment. Any views or opinions expressed by the author of this email do not necessarily reflect the views of the University of Nottingham.<u></u><u></u><BR>
This message has been checked for viruses but the contents of an attachment may still contain software viruses which could damage your computer system, you are advised to perform your own checks. Email communications with the University of Nottingham may be monitored as permitted by UK legislation.<u></u><u></u><BR>
<p class="ecxMsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman","serif";"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span lang="EN-US" style="font-size:12.0pt;font-family:"Times New Roman","serif";"><br>
</span><span lang="EN-US" style="font-size:10.0pt;font-family:"Arial","sans-serif";color:gray;">Glasgow Caledonian University is a registered Scottish charity, number SC021474<br><br>Winner: Times Higher Education’s Widening Participation Initiative of the Year 2009 and Herald Society’s Education Initiative of the Year 2009.<br>
<a href="http://www.gcu.ac.uk/newsevents/news/bycategory/theuniversity/1/name%2c6219%2cen.html" target="_blank">http://www.gcu.ac.uk/newsevents/news/bycategory/theuniversity/1/name,6219,en.html</a><br><br>Winner: Times Higher Education’s Outstanding Support for Early Career Researchers of the Year 2010, GCU as a lead with Universities Scotland partners.<br>
<a href="http://www.gcu.ac.uk/newsevents/news/bycategory/theuniversity/1/name%2c15691%2cen.html" target="_blank">http://www.gcu.ac.uk/newsevents/news/bycategory/theuniversity/1/name,15691,en.html</a></span><span lang="EN-US" style="font-size:12.0pt;font-family:"Times New Roman","serif";"><u></u><u></u></span></p>
<p class="ecxMsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman","serif";"><u></u> <u></u></span></p>This message and any attachment are intended solely for the addressee and may contain confidential information. If you have received this message in error, please send it back to me, and immediately delete it. Please do not use, copy or disclose the information contained in this message or in any attachment. Any views or opinions expressed by the author of this email do not necessarily reflect the views of the University of Nottingham.<u></u><u></u><BR>
This message has been checked for viruses but the contents of an attachment may still contain software viruses which could damage your computer system, you are advised to perform your own checks. Email communications with the University of Nottingham may be monitored as permitted by UK legislation.<u></u><u></u><BR>
<p class="ecxMsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman","serif";"><u></u> <u></u></span></p><p class="ecxMsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman","serif";"><u></u> <u></u></span></p>
This message and any attachment are intended solely for the addressee and may contain confidential information. If you have received this message in error, please send it back to me, and immediately delete it. Please do not use, copy or disclose the information contained in this message or in any attachment. Any views or opinions expressed by the author of this email do not necessarily reflect the views of the University of Nottingham.<u></u><u></u><BR>
This message has been checked for viruses but the contents of an attachment may still contain software viruses which could damage your computer system, you are advised to perform your own checks. Email communications with the University of Nottingham may be monitored as permitted by UK legislation.<u></u><u></u><BR>
<p class="ecxMsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman","serif";"><u></u> <u></u></span></p></div>
<br>This message and any attachment are intended solely for the addressee and may contain confidential information. If you have received this message in error, please send it back to me, and immediately delete it. Please do not use, copy or disclose the information contained in this message or in any attachment. Any views or opinions expressed by the author of this email do not necessarily reflect the views of the University of Nottingham.<BR>
This message has been checked for viruses but the contents of an attachment may still contain software viruses which could damage your computer system, you are advised to perform your own checks. Email communications with the University of Nottingham may be monitored as permitted by UK legislation.<BR>
<br></div><br>_______________________________________________<br>
Xerte-dev mailing list<br>
<a href="mailto:Xerte-dev@lists.nottingham.ac.uk">Xerte-dev@lists.nottingham.ac.uk</a><br>
<a href="http://lists.nottingham.ac.uk/mailman/listinfo/xerte-dev" target="_blank">http://lists.nottingham.ac.uk/mailman/listinfo/xerte-dev</a><br>
<br></blockquote></div><br></div>
<br>_______________________________________________
Xerte-dev mailing list
Xerte-dev@lists.nottingham.ac.uk
http://lists.nottingham.ac.uk/mailman/listinfo/xerte-dev</div></div></div> </div></body>
</html>