.. _changelog:

Changelog

=========

1.2.0 (**2011-XX-XX**)

======================

:status: in-progress

:branch: beta

news

----

- implemented #89 Can setup google analytics code from settings menu

- implemented #91 added nicer looking archive urls

- implemented #44 into file browsing, and added follow branch option

- anonymous repository can be cloned without having to pass default:default

  into clone url

- fixed #90 whoosh indexer can index chooses repositories passed in command 

  line

- added dynamic download links in summary. With quick branch/tag selection

fixes

-----

- fixed file browser bug, when switching into given form revision the url was 

  not changing

- fixed propagation to error controller on simplehg and simplegit middlewares

1.1.2 (**2011-01-12**)

======================

news

----

fixes

-----

- fixes #98 protection against float division of percentage stats

- fixed graph bug

- forced webhelpers version since it was making troubles during installation 

1.1.1 (**2011-01-06**)

======================

news

----

- added force https option into ini files for easier https usage (no need to

  set server headers with this options)

- small css updates

fixes

-----

- fixed #96 redirect loop on files view on repositories without changesets

- fixed #97 unicode string passed into server header in special cases (mod_wsgi)

  and server crashed with errors

- fixed large tooltips problems on main page

- fixed #92 whoosh indexer is more error proof

1.1.0 (**2010-12-18**)

======================

news

----

- rewrite of internals for vcs >=0.1.10

- uses mercurial 1.7 with dotencode disabled for maintaining compatibility 

  with older clients

- anonymous access, authentication via ldap

- performance upgrade for cached repos list - each repository has it's own 

  cache that's invalidated when needed.

- performance upgrades on repositories with large amount of commits (20K+)

- main page quick filter for filtering repositories

- user dashboards with ability to follow chosen repositories actions

- sends email to admin on new user registration

- added cache/statistics reset options into repository settings

- more detailed action logger (based on hooks) with pushed changesets lists

  and options to disable those hooks from admin panel

- introduced new enhanced changelog for merges that shows more accurate results

- new improved and faster code stats (based on pygments lexers mapping tables, 

  showing up to 10 trending sources for each repository. Additionally stats

  can be disabled in repository settings.

- gui optimizations, fixed application width to 1024px

- added cut off (for large files/changesets) limit into config files

- whoosh, celeryd, upgrade moved to paster command

- other than sqlite database backends can be used

fixes

-----

- fixes #61 forked repo was showing only after cache expired

- fixes #76 no confirmation on user deletes

- fixes #66 Name field misspelled

- fixes #72 block user removal when he owns repositories

- fixes #69 added password confirmation fields

- fixes #87 RhodeCode crashes occasionally on updating repository owner

- fixes #82 broken annotations on files with more than 1 blank line at the end

- a lot of fixes and tweaks for file browser

- fixed detached session issues

- fixed when user had no repos he would see all repos listed in my account

- fixed ui() instance bug when global hgrc settings was loaded for server 

  instance and all hgrc options were merged with our db ui() object

- numerous small bugfixes

(special thanks for TkSoh for detailed feedback)

1.0.2 (**2010-11-12**)

======================

news

----

- tested under python2.7

- bumped sqlalchemy and celery versions

fixes

-----

- fixed #59 missing graph.js

- fixed repo_size crash when repository had broken symlinks

- fixed python2.5 crashes.

1.0.1 (**2010-11-10**)

======================

news

----

- small css updated

fixes

-----

- fixed #53 python2.5 incompatible enumerate calls

- fixed #52 disable mercurial extension for web

- fixed #51 deleting repositories don't delete it's dependent objects

1.0.0 (**2010-11-02**)

======================

- security bugfix simplehg wasn't checking for permissions on commands

  other than pull or push.

- fixed doubled messages after push or pull in admin journal

- templating and css corrections, fixed repo switcher on chrome, updated titles

- admin menu accessible from options menu on repository view

- permissions cached queries

1.0.0rc4  (**2010-10-12**)

==========================

- fixed python2.5 missing simplejson imports (thanks to Jens Bäckman)

- removed cache_manager settings from sqlalchemy meta

- added sqlalchemy cache settings to ini files

- validated password length and added second try of failure on paster setup-app

- fixed setup database destroy prompt even when there was no db

1.0.0rc3 (**2010-10-11**)

=========================

- fixed i18n during installation.

1.0.0rc2 (**2010-10-11**)

=========================

- Disabled dirsize in file browser, it's causing nasty bug when dir renames 

  occure. After vcs is fixed it'll be put back again.

- templating/css rewrites, optimized css.

# -*- coding: utf-8 -*-

"""

    rhodecode.controllers.files

    ~~~~~~~~~~~~~~~~~~~~~~~~~~~

    Files controller for RhodeCode

    :created_on: Apr 21, 2010

    :author: marcink

    :copyright: (C) 2009-2011 Marcin Kuzminski <marcin@python-works.com>    

    :license: GPLv3, see COPYING for more details.

"""

# This program is free software; you can redistribute it and/or

# modify it under the terms of the GNU General Public License

# as published by the Free Software Foundation; version 2

# of the License or (at your opinion) any later version of the license.

# 

# This program is distributed in the hope that it will be useful,

# but WITHOUT ANY WARRANTY; without even the implied warranty of

# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the

# GNU General Public License for more details.

# 

# You should have received a copy of the GNU General Public License

# along with this program; if not, write to the Free Software

# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston,

# MA  02110-1301, USA.

import tempfile

import logging

import rhodecode.lib.helpers as h

from mercurial import archival

from pylons import request, response, session, tmpl_context as c, url

from pylons.i18n.translation import _

from pylons.controllers.util import redirect

from rhodecode.lib.auth import LoginRequired, HasRepoPermissionAnyDecorator

from rhodecode.lib.base import BaseController, render

from rhodecode.lib.utils import EmptyChangeset

from rhodecode.model.scm import ScmModel

from vcs.exceptions import RepositoryError, ChangesetError, \

    ChangesetDoesNotExistError, EmptyRepositoryError

from vcs.nodes import FileNode

from vcs.utils import diffs as differ

log = logging.getLogger(__name__)

class FilesController(BaseController):

    @LoginRequired()

    @HasRepoPermissionAnyDecorator('repository.read', 'repository.write',

                                   'repository.admin')

    def __before__(self):

        super(FilesController, self).__before__()

        c.cut_off_limit = self.cut_off_limit

    def index(self, repo_name, revision, f_path):

        hg_model = ScmModel()

        c.repo = hg_model.get_repo(c.repo_name)

        try:

            #reditect to given revision from form

            post_revision = request.POST.get('at_rev', None)

            if post_revision:

                post_revision = c.repo.get_changeset(post_revision).raw_id

                redirect(url('files_home', repo_name=c.repo_name,

                             revision=post_revision, f_path=f_path))

            c.branch = request.GET.get('branch', None)

            c.f_path = f_path

            c.changeset = c.repo.get_changeset(revision)

            cur_rev = c.changeset.revision

            #prev link

            try:

                prev_rev = c.repo.get_changeset(cur_rev).prev(c.branch).raw_id

                c.url_prev = url('files_home', repo_name=c.repo_name,

                             revision=prev_rev, f_path=f_path)

                if c.branch:

                    c.url_prev += '?branch=%s' % c.branch

            except ChangesetDoesNotExistError:

                c.url_prev = '#'

            #next link

            try:

                next_rev = c.repo.get_changeset(cur_rev).next(c.branch).raw_id

                c.url_next = url('files_home', repo_name=c.repo_name,

                         revision=next_rev, f_path=f_path)

                if c.branch:

                    c.url_next += '?branch=%s' % c.branch

            except ChangesetDoesNotExistError:

                c.url_next = '#'

            #files

            try:

                c.files_list = c.changeset.get_node(f_path)

                c.file_history = self._get_history(c.repo, c.files_list, f_path)

            except RepositoryError, e:

                h.flash(str(e), category='warning')

                redirect(h.url('files_home', repo_name=repo_name, revision=revision))

        except EmptyRepositoryError, e:

            h.flash(_('There are no files yet'), category='warning')

            redirect(h.url('summary_home', repo_name=repo_name))

        except RepositoryError, e:

            h.flash(str(e), category='warning')

            redirect(h.url('files_home', repo_name=repo_name, revision='tip'))

        return render('files/files.html')

    def rawfile(self, repo_name, revision, f_path):

        hg_model = ScmModel()

        c.repo = hg_model.get_repo(c.repo_name)

        file_node = c.repo.get_changeset(revision).get_node(f_path)

        response.content_type = file_node.mimetype

        response.content_disposition = 'attachment; filename=%s' \

                                                    % f_path.split('/')[-1]

        return file_node.content

    def raw(self, repo_name, revision, f_path):

        hg_model = ScmModel()

        c.repo = hg_model.get_repo(c.repo_name)

        file_node = c.repo.get_changeset(revision).get_node(f_path)

        response.content_type = 'text/plain'

        return file_node.content

    def annotate(self, repo_name, revision, f_path):

        hg_model = ScmModel()

        c.repo = hg_model.get_repo(c.repo_name)

        try:

            c.cs = c.repo.get_changeset(revision)

            c.file = c.cs.get_node(f_path)

        except RepositoryError, e:

            h.flash(str(e), category='warning')

            redirect(h.url('files_home', repo_name=repo_name, revision=revision))

        c.file_history = self._get_history(c.repo, c.file, f_path)

        c.f_path = f_path

        return render('files/files_annotate.html')

    def archivefile(self, repo_name, fname):

        archive_specs = {

          '.tar.bz2': ('application/x-tar', 'tbz2'),

          '.tar.gz': ('application/x-tar', 'tgz'),

          '.zip': ('application/zip', 'zip'),

        }

        fileformat = None

        revision = None

        for ext in archive_specs.keys():

            archive_spec = fname.split(ext)

            if len(archive_spec) == 2:

                fileformat = archive_spec[1] or ext

                revision = archive_spec[0]

        if not archive_specs.has_key(fileformat):

            return _('Unknown archive type')

        repo = ScmModel().get_repo(repo_name)

        try:

            repo.get_changeset(revision)

        except ChangesetDoesNotExistError:

            return _('Unknown revision %s') % revision

        archive = tempfile.TemporaryFile()

        localrepo = repo.repo

        fname = '%s-%s%s' % (repo_name, revision, fileformat)

        archival.archive(localrepo, archive, revision, archive_specs[fileformat][1],

                         prefix='%s-%s' % (repo_name, revision))

        response.content_type = archive_specs[fileformat][0]

        response.content_disposition = 'attachment; filename=%s' % fname

        archive.seek(0)

        def read_in_chunks(file_object, chunk_size=1024 * 40):

            """Lazy function (generator) to read a file piece by piece.

            Default chunk size: 40k."""

            while True:

                data = file_object.read(chunk_size)

                if not data:

                    break

                yield data

        return read_in_chunks(archive)

    def diff(self, repo_name, f_path):

        hg_model = ScmModel()

        diff1 = request.GET.get('diff1')

        diff2 = request.GET.get('diff2')

        c.action = request.GET.get('diff')

        c.no_changes = diff1 == diff2

        c.f_path = f_path

        c.repo = hg_model.get_repo(c.repo_name)

        try:

            if diff1 not in ['', None, 'None', '0' * 12, '0' * 40]:

                c.changeset_1 = c.repo.get_changeset(diff1)

                node1 = c.changeset_1.get_node(f_path)

            else:

                c.changeset_1 = EmptyChangeset()

                node1 = FileNode('.', '', changeset=c.changeset_1)

            if diff2 not in ['', None, 'None', '0' * 12, '0' * 40]:

                c.changeset_2 = c.repo.get_changeset(diff2)

                node2 = c.changeset_2.get_node(f_path)

            else:

                c.changeset_2 = EmptyChangeset()

                node2 = FileNode('.', '', changeset=c.changeset_2)

        except RepositoryError:

            return redirect(url('files_home',

                                repo_name=c.repo_name, f_path=f_path))

        f_udiff = differ.get_udiff(node1, node2)

        diff = differ.DiffProcessor(f_udiff)

        if c.action == 'download':

            diff_name = '%s_vs_%s.diff' % (diff1, diff2)

            response.content_type = 'text/plain'

            response.content_disposition = 'attachment; filename=%s' \

                                                    % diff_name

            return diff.raw_diff()

        elif c.action == 'raw':

            response.content_type = 'text/plain'

            return diff.raw_diff()

        elif c.action == 'diff':

            if node1.size > self.cut_off_limit or node2.size > self.cut_off_limit:

                c.cur_diff = _('Diff is to big to display')

            else:

                c.cur_diff = diff.as_html()

        else:

            #default option

            if node1.size > self.cut_off_limit or node2.size > self.cut_off_limit:

                c.cur_diff = _('Diff is to big to display')

            else:

                c.cur_diff = diff.as_html()

        if not c.cur_diff: c.no_changes = True

        return render('files/file_diff.html')

    def _get_history(self, repo, node, f_path):

        from vcs.nodes import NodeKind

        if not node.kind is NodeKind.FILE:

            return []

        changesets = node.history

        hist_l = []

        changesets_group = ([], _("Changesets"))

        branches_group = ([], _("Branches"))

        tags_group = ([], _("Tags"))

        for chs in changesets:

            n_desc = 'r%s:%s' % (chs.revision, chs.short_id)

            changesets_group[0].append((chs.raw_id, n_desc,))

        hist_l.append(changesets_group)

        for name, chs in c.repository_branches.items():

            #chs = chs.split(':')[-1]

            branches_group[0].append((chs, name),)

        hist_l.append(branches_group)

        for name, chs in c.repository_tags.items():

            #chs = chs.split(':')[-1]

            tags_group[0].append((chs, name),)

        hist_l.append(tags_group)

        return hist_l

<%inherit file="/base/base.html"/>

<%def name="title()">

    ${c.repo_name} ${_('Summary')} - ${c.rhodecode_name}

</%def>

<%def name="breadcrumbs_links()">

    ${h.link_to(u'Home',h.url('/'))}

    » 

    ${h.link_to(c.repo_name,h.url('summary_home',repo_name=c.repo_name))}

    »

    ${_('summary')}

</%def>

<%def name="page_nav()">

	${self.menu('summary')}    

</%def>

<%def name="main()">

<div class="box box-left">

    <!-- box / title -->

    <div class="title">

        ${self.breadcrumbs()}

    </div>

    <!-- end box / title -->

	<div class="form">

	  <div class="fields">

			 <div class="field">

			  <div class="label">

			      <label>${_('Name')}:</label>

			  </div>

			  <div class="input-short">

		         %if c.repo_info.dbrepo.repo_type =='hg':

		           <img style="margin-bottom:2px" class="icon" title="${_('Mercurial repository')}" alt="${_('Mercurial repository')}" src="/images/icons/hgicon.png"/>

		         %endif

		         %if c.repo_info.dbrepo.repo_type =='git':

		           <img style="margin-bottom:2px" class="icon" title="${_('Git repository')}" alt="${_('Git repository')}" src="/images/icons/giticon.png"/>

		         %endif 

	             %if c.repo_info.dbrepo.private:

	                <img style="margin-bottom:2px" class="icon" title="${_('private repository')}" alt="${_('private repository')}" src="/images/icons/lock.png"/>

	             %else:

	                <img style="margin-bottom:2px" class="icon" title="${_('public repository')}" alt="${_('public repository')}" src="/images/icons/lock_open.png"/>

	             %endif

			      <span style="font-size: 1.6em;font-weight: bold;vertical-align: baseline;">${c.repo_info.name}</span>

			      %if c.rhodecode_user.username != 'default':

				      %if c.following:

	                  <span id="follow_toggle" class="following" title="${_('Stop following this repository')}"

	                        onclick="javascript:toggleFollowingRepo(${c.repo_info.dbrepo.repo_id},'${str(h.get_token())}')">

	                  </span>			      

				      %else:

				      <span id="follow_toggle" class="follow" title="${_('Start following this repository')}"

				            onclick="javascript:toggleFollowingRepo(${c.repo_info.dbrepo.repo_id},'${str(h.get_token())}')">

				      </span>

				      %endif

				  %endif:

			      <br/>

		            %if c.repo_info.dbrepo.fork:

		            	<span style="margin-top:5px">

		            	<a href="${h.url('summary_home',repo_name=c.repo_info.dbrepo.fork.repo_name)}">

		            	<img class="icon" alt="${_('public')}"

		            	title="${_('Fork of')} ${c.repo_info.dbrepo.fork.repo_name}" 

		            	src="/images/icons/arrow_divide.png"/>

		            	${_('Fork of')} ${c.repo_info.dbrepo.fork.repo_name}

		            	</a>

		            	</span>

		            %endif			      

			  </div>

			 </div>

			 <div class="field">

			  <div class="label">

			      <label>${_('Description')}:</label>

			  </div>

			  <div class="input-short">

			      ${c.repo_info.dbrepo.description}

			  </div>

			 </div>

			 <div class="field">

			  <div class="label">

			      <label>${_('Contact')}:</label>

			  </div>

			  <div class="input-short">

			  	<div class="gravatar">

			  		<img alt="gravatar" src="${h.gravatar_url(c.repo_info.dbrepo.user.email)}"/>

			  	</div>

			  		${_('Username')}: ${c.repo_info.dbrepo.user.username}<br/>

			  		${_('Name')}: ${c.repo_info.dbrepo.user.name} ${c.repo_info.dbrepo.user.lastname}<br/>

			  		${_('Email')}: <a href="mailto:${c.repo_info.dbrepo.user.email}">${c.repo_info.dbrepo.user.email}</a>

			  </div>

			 </div>

			 <div class="field">

			  <div class="label">

			      <label>${_('Last change')}:</label>

			  </div>

			  <div class="input-short">

			      ${h.age(c.repo_info.last_change)} - ${c.repo_info.last_change} 

			      ${_('by')} ${h.get_changeset_safe(c.repo_info,'tip').author} 

			  </div>

			 </div>

			 <div class="field">

			  <div class="label">

			      <label>${_('Clone url')}:</label>

			  </div>

			  <div class="input-short">

			      <input type="text" id="clone_url" readonly="readonly" value="hg clone ${c.clone_repo_url}" size="70"/>

			  </div>

			 </div>

			 <div class="field">

			  <div class="label">

			      <label>${_('Trending source files')}:</label>

			  </div>

			  <div class="input-short">

			    <div id="lang_stats"></div> 			   

			  </div>

			 </div>

			 <div class="field">

			  <div class="label">

			      <label>${_('Download')}:</label>

			  </div>

			  <div class="input-short">

			  </div>

			 </div>

			 <div class="field">

			  <div class="label">

			      <label>${_('Feeds')}:</label>

			  </div>

			  <div class="input-short">

	            ${h.link_to(_('RSS'),h.url('rss_feed_home',repo_name=c.repo_info.name),class_='rss_icon')}

	            ${h.link_to(_('Atom'),h.url('atom_feed_home',repo_name=c.repo_info.name),class_='atom_icon')}

			  </div>

			 </div>				 			 			 

	  </div>		 

	</div>

  	<script type="text/javascript">

	  	YUE.onDOMReady(function(e){

	  	    id = 'clone_url';

	  	    YUE.on(id,'click',function(e){

	  	        YUD.get('clone_url').select();

	  	    })

	  	})

  		var data = ${c.trending_languages|n};

  		var total = 0;

  		var no_data = true;

  		for (k in data){

  		    total += data[k];

  		    no_data = false;

  		} 

		var tbl = document.createElement('table');

		tbl.setAttribute('class','trending_language_tbl');

		var cnt =0;

  		for (k in data){

  			cnt+=1;

  			var hide = cnt>2;

	  		var tr = document.createElement('tr');

	  		if (hide){

	  			tr.setAttribute('style','display:none');

	  			tr.setAttribute('class','stats_hidden');

	  		}

	  		var percentage = Math.round((data[k]/total*100),2);

			var value = data[k];

	  		var td1 = document.createElement('td');

	  		td1.width=150;

	  		var trending_language_label = document.createElement('div');

	  		trending_language_label.innerHTML = k;

	  		td1.appendChild(trending_language_label);

	  		var td2 = document.createElement('td');

	  		td2.setAttribute('style','padding-right:14px !important');

  		    var trending_language = document.createElement('div');

  		    var nr_files = value+" ${_('files')}";

  		    trending_language.title = k+" "+nr_files;

  		    if (percentage>20){

  		    	trending_language.innerHTML = "<b style='font-size:0.8em'>"+percentage+"% "+nr_files+ "</b>";	

  		    }

  		    else{

  		    	trending_language.innerHTML = "<b style='font-size:0.8em'>"+percentage+"%</b>";

  		    }

  		    trending_language.setAttribute("class", 'trending_language top-right-rounded-corner bottom-right-rounded-corner');

  		    trending_language.style.width=percentage+"%";

			td2.appendChild(trending_language);

			tr.appendChild(td1);

			tr.appendChild(td2);

  		    tbl.appendChild(tr);

  		    if(cnt == 2){

  		    	var show_more = document.createElement('tr');

  		    	var td=document.createElement('td');

  		    	lnk = document.createElement('a');

  		    	lnk.href='#';

  		    	lnk.innerHTML = "${_("show more")}";

  		    	lnk.id='code_stats_show_more';

  		        td.appendChild(lnk);

  		    	show_more.appendChild(td);

  		    	show_more.appendChild(document.createElement('td'));

  		    	tbl.appendChild(show_more);

  		    }

  		}

  		if(no_data){

  			var tr = document.createElement('tr');

  			var td1 = document.createElement('td');

  			td1.innerHTML = "${c.no_data_msg}";

  			tr.appendChild(td1);

  			tbl.appendChild(tr);

		}

  		YUD.get('lang_stats').appendChild(tbl);

  		YUE.on('code_stats_show_more','click',function(){

  			l = YUD.getElementsByClassName('stats_hidden')

  			for (e in l){

  			    YUD.setStyle(l[e],'display','');

  			};

  			YUD.setStyle(YUD.get('code_stats_show_more'),

  					'display','none');

  		})

             YUE.on('download_options','change',function(e){

                 var new_cs = e.target.options[e.target.selectedIndex];

                 var tmpl_links = {}

                 %for cnt,archive in enumerate(c.repo_info._get_archives()):

                	 tmpl_links['${archive['type']}'] = '${h.link_to(archive['type'],

                        h.url('files_archive_home',repo_name=c.repo_info.name,

                        fname='__CS__'+archive['extension']),class_="archive_icon")}';

                 %endfor

                 for(k in tmpl_links){

                	 var s = YUD.get(k+'_link')

                	 title_tmpl = "${_('Download %s as %s') % ('__CS_NAME__',archive['type'])}";

                	 s.title = title_tmpl.replace('__CS_NAME__',new_cs.text)

                	 s.innerHTML = tmpl_links[k].replace('__CS__',new_cs.value);

                 }

             })

  	</script>    				

</div>

<div class="box box-right"  style="min-height:455px">

    <!-- box / title -->

    <div class="title">

        <h5>${_('Commit activity by day / author')}</h5>

    </div>

    <div class="table">

         %if c.no_data:

           <div style="padding:0 10px 10px 15px;font-size: 1.2em;">${c.no_data_msg}

           %if h.HasPermissionAll('hg.admin')('enable stats on from summary'):

                [${h.link_to(_('enable'),h.url('edit_repo',repo_name=c.repo_name))}]

           </div>

        %endif:  

        <div id="commit_history" style="width:460px;height:300px;float:left"></div>

        <div style="clear: both;height: 10px"></div>

        <div id="overview" style="width:460px;height:100px;float:left"></div>

    	<div id="legend_data" style="clear:both;margin-top:10px;">

	    	<div id="legend_container"></div>

	    	<div id="legend_choices">

				<table id="legend_choices_tables" style="font-size:smaller;color:#545454"></table>

	    	</div>

    	</div>

		<script type="text/javascript">

		/**

		 * Plots summary graph

		 *

		 * @class SummaryPlot

		 * @param {from} initial from for detailed graph

		 * @param {to} initial to for detailed graph

		 * @param {dataset}

		 * @param {overview_dataset}

		 */

		function SummaryPlot(from,to,dataset,overview_dataset) {

			var initial_ranges = {

			    "xaxis":{

				    "from":from,

				   	"to":to,

				},