There's already a second post, outlining the initial ground rules for people who would like to take part. As with just about everything else about this project, they are a valid subject for discussion.
Opportunity
I've become aware of an increasing interest in large-scale distributed collaboration; the tools available do not seem very suitable to the task; and -- perhaps most importantly -- awareness is emerging that the collaboration tools could be better-designed.
There's a feedback loop between the quality of the toolset and the quality of the collaboration, and I have in mind a collaborative project designed to take advantage of that feedback loop, using its own product (the collaborative toolset) in the process of designing, coding, testing, and improving it.
This message is intended as an invitation for collaboration by any interested parties.
Background
Three factors are important for any potential contributor to the project:
- A general knowledge of collaborative communities. Of particular value: theoretical knowledge of the factors which cause a community to succeed or to fail; experience with one or more of the successful online communities; and current active participation in such communities. Best of all would be experience managing such a community, especially(!) if it ultimately failed.
- Possession of any of the specific skills needed for the development effort. We'll need to do some coding, but there's a whole range of needed skills, including social engineering, cognitive psychology, human interface design, social network analysis, and so on. If there's a way you think you can help, you probably can. Even if you only want to use the fruits of our labour, we'd still like to get your input about what is required.
- I like working closely with people who know how to behave themselves socially. Translation: be nice or get lost.
Criteria for Success
- Health of the community
- reasonableness of the core people
- competence of the core people
- group social engineering
- usability of the initial platform
- Benefits to the community
- prominent exposure if we succeed
- opportunity to prove competence publicly
- possibility of eventual sponsorship of the effort
- Solving challenges (roughly chronological)
- management: cultivate awareness of the project
- social engineering: cultivate high-quality feedback
- design:
- lower barriers to participation in the community
- make it attractive, to attract participation in the community
- lower barriers to communication
- solve the "I speak when I want; you listen when you want" problem
- solve the "right amount of communication" problem
- incorporate and improve existing visualization and summarization tools
- thinking: anticipate and subvert monopolies
- democratize the viral network effect
- avoid leader worship
- facilitate branching & merging
- technical: the liquidity of trust kernel (described below)
Liquidity of Trust Kernel
The big technical challenge for the project concerns what I'm calling the liquidity of trust.
When someone participates in a collaborative project, they gradually earn the trust of their colleagues. Currently, this works very well for the people leading the project (e.g, Linus Torvalds, Richard Stallman, Pamela Jones, etc.,) -- the trust they have earned is well-known to the public, and it's easy for them to convert that trust into something of more immediate use such as academic prominence, paying jobs, etc.
It doesn't work so well for the people who play less prominent roles -- they establish the trust of the others within the community, but basically can't do very much to transfer that trust outside. This is especially problematic for the people who play supporting roles -- the system rewards flashy behaviour, but not the quiet, steady contribution.
I think it's essential in the long run to find an effective way to allow all kinds of trust (and distrust), established within one community, to be transferrable to another. This won't be easy, but I don't think it's beyond the capabilities of a carefully-constructed "super-programmer", and I won't be satisfied until we get it "just right". For this part of the project I also would like to quote djb: "I won’t be satisfied until I've put the entire security industry out of work".
For the time being, however, I think it suffices to commit ourselves to providing candid recommendations for people who contribute substantially to the effort.
Models
- Tea Time -- the combination of the social and the mathematical hosted by math departments
- Slashdot (comment moderation system)
- Groklaw (massively collaborative community)
- Stackoverflow (explicit treatment of trust)
- GNU/linux (massive collaboration in a programming effort)
- EVE online and other MMOGs (casual social cooperation)
- Timothy Gowers' 'Is massively collaborative mathematics possible?' (functioning fine-grained collaboration)
Daniel Mietchen has some comments on this project, and some useful links, in his blog entry
ReplyDeleteSome points:
1. The 'Liquidity of Trust Kernel' is supposed to solve the problem neatly described in one of his links.
2. I favor using real names in most cases, but wouldn't want to insist on them.
3. I too wouldn't rule out a wiki, either in conjunction with or in addition to this blog format.
Priorities:
ReplyDelete1. Determining what features are most needed for close collaboration.
2. Planning the "first bootstrap", e.g., the selection of the next technology platform and planning any required modifications.
@njt
ReplyDeleteSuggestions...
The most pressing need seems to me the capability to "filter and relate" the bits and pieces of informal contributions according to everyone's personal tastes.
No single "doctrine" will do because the doctrine IS what we are really looking after.
Seeing how the Gowers experiment is already bogged down in nasty practical details (comments numbering, thread titles, overlooked remarks, etc...) I think the focus should be on customizable functionalities of the user interface.
Something like the TiddlyDesktop appear to be a valuable basis, of course it will have to be beefed up to support permanent storage and multiple concurrent users.
An old project of mine in which I lost interest might also provide a few hints (NOT any code alas, it's terribly "experimental") about using AJAX.
As for storage of the "bits and pieces", instead of flat files or a vanilla database GIT seem to be an obvious answer, providing a sane basis for sharing and versioning.
The principal benefit of a smart client side will be the capability to add finely tailored views (various kind of cross referencings and groupings) of the raw data as necessities will show up which cannot be anticipated.
About what kind of cross references to maintain the ideas developed by Stuart Frazier Allen in "Abstract identifiers, intertextual reference and a computational basis for recordkeeping" also seem worthwhile.
Community building is important.
ReplyDeleteI think that I was wrong about the priorities above, and that in fact it's vital to put some energy into building the community now.
To that end, I'm going to draft a letter to Pamela Jones of Groklaw, in the hope of attracting some attention from that project. I'm definitely hoping that this software effort could be useful to them.
Kevembuangga has some good ideas (in particular, his old project is indeed a good reference, and I agree with GIT as the obvious eventual choice for storage). This is exactly the sort of information we're going to need to make the project a success in the long run.
ReplyDeleteI'd also like to draw attention to some shorter-term considerations. In roughly chronological order, I anticipate the need to solve:
1. The conflict between keeping low barriers to entry and keeping out the spammers. Right now, anyone can comment (even a spambot), and I'm definitely anticipating the need to change the settings to keep out the riff-raff. When I do, it will become a little harder for people to comment.
2. A first-cut solution to the "filtering and relating" problem. At this stage, we have an easy first move, to another available platform which is superior in this regard. Even something as simple as Geeklog (which has threaded, titled comments) would be a big improvement. [ I chose blogger because it's both easy to set up and very good at interconnectivity with other blogs ]
3. The selection of a sound platform in which to experiment with improved "filtering and relating" algorithms and methods. At the moment, the default platform for me would be Elgg.
4. The design and implementation of some of those "filtering and relating" ideas.
The basic approach I favor is iterative, paying enough attention to the longer-term considerations so we don't paint ourselves into a corner, and enough attention to the pressing problems that we keep moving forward.
Michael Nielsen on doing science online.
ReplyDeleteCommunity building is important
ReplyDeleteYes, but I don't see this as a short term priority.
A community will form "naturally" if the work frame is attractive and it can always be added "on the side" of the discussion board proper with any other appropriate tool.
A first-cut solution
Much depends on the expected time scale of development, what is the point of creating a clumsy "sketch of a tool" which will neither allow to test interesting ideas nor be a sound basis for a finished product?
low barriers to entry
OpenID + captchas, spambots are indeed a plague and the Chinese spammers even use human "slaves" to pass thru captchas, but this problem will only show up much later when the discussion board(s) will be heavily referenced on the net.
selection of a sound platform
ANY existing platform will bring with it a lot of useless bells and whistles which will have to be supported, will interfere with the really sought for functionalities and will distract users from the main goal of organizing discussions.
I would much more favor plugging GIT commits into a bare bones wiki/tiddlywiki via some AJAX hooks.
those "filtering and relating" ideas
What I was thinking about was a capability to add specialized plugins which would by themselves create extra links, references and annotations to the discussion texts without any user intervention by scooping up the whole content of a discussion for keywords, similarities, etc... this is where the experimentation on functionalities would take place.
so we don't paint ourselves into a corner, and enough attention to the pressing problems
I am afraid that you cannot have your cake and eat it too, you will have to choose between "grand schemes" and tinkering.
I would favor "efficient" tinkering, Worse is better
A very common failing of open-source efforts is that they tend to solve problems encountered by programmers, and to ignore problems encountered by other people.
ReplyDeleteAnother way of saying this is that they tend to skip over the requirements and design goals phase of a project and go straight to implementation. This is understandable -- most programmers much prefer thinking about implementation details.
I would like to avoid these mistakes. For that reason, this experiment is 'community first', and I definitely want to involve a number of people who don't know much about programming in the discussion of what's most needed before we spend too much time talking about implementation details.
I'm working on two posts. The first is easy -- it's a post to hold comments about implementation. The reason for segregating that part is to keep eyes from glazing over for the people who don't have the appropriate background.
ReplyDeleteThe second will take a little more time. Gowers' discussion is the first public collaboration I'm aware of that has the property of 'group self-awareness'. Another way of saying this is that it's a self-aware massively collaborative thinker. The planned title is 'Introspection'.
There's an interesting Slashdot discussion, Web of Trust For Scientific Publications. I'm envisioning something substantially finer-grained, taking place on an individual comment level, but this sort of thing is exactly what I mean by the 'Liquidity of Trust Kernel'
ReplyDeleteOn the community-awareness front, I'm thinking of drafting an article for Slashdot, along the lines of 'Slashdot on Slashdot -- how to improve the moderation system and fix the annoyances'.
ReplyDeleteI think it makes sense to finish the 'Introspection' article here first, and out of fear of the Slashdot effect (and the general rowdiness of that community) I'd probably want to tighten the comment policy first.
Kevembuangga said, "I am afraid that you cannot have your cake and eat it too, you will have to choose between "grand schemes" and tinkering."
ReplyDeleteI do have a "grand scheme" in mind (the LQTK), but think that we'll need a community before it's possible to really address it, and that we'll need to do a fair bit of tinkering in the process of building that community.
I noticed a cool feature of Wordpress that allows me to illustrate a little bit of what I mean by the LQTK (LiQuidity of Trust Kernel):
ReplyDeleteIn a moderated blog, once a comment has been accepted, that author is given permission to post comments without further moderation. What I'd really like to be able to do is to say, e.g., "I trust 'blogger X' enough that when they accept a comment I'd like my blog to do the same".
This is the problem. Solutions?
I love the idea of building a better way for mathematicians and others to collaborate.
ReplyDeleteCouple thoughts for now:
- In terms of the "liquidity of trust" problem, could that not be solved using the Wikipedia strategy of keeping track of versions and rewarding people that contributed the most (perhaps with some way of measuring the influence on individual commits) ?
- It would be interesting to see how far you can take the common set of open source conventions for developing software and see how that applies to developing theorems (I realize what you are interested doing is broader than just mathematics)
- To solve the "filter and relate" problem you describe, you could think about a personalizable wiki, where you have discrete units, e.g. document, or sub-proof, etc. and those units can be shuffled, sorted, and filtered according to each person's desires.
- I like the high level of ambition in this project but focus and clear roadmap for how to connect the first steps to the end vision will be critical
cheers,
Scott
Scott,
ReplyDeleteIn terms of the 'liquidity of trust' problem, I object to the 'one-dimensional' nature of a simple model like Wikipedia or like Stackoverflow.
The defect comes because different people are good at different things. Some prominent open-source projects have run into trouble because their leaders, while being exceptionally proficient at many things, make poor diplomats.
For this reason, I think some sort of multi-dimensional model is called for, with, say, 'good at solving debugging problems' on one axis and 'good at solving diplomatic problems' on another.
As for the roadmap, the plan I have in mind is to explore and solve the 'liquidity of trust' problem. I imagine that on the way there we'll be sharing information about (and possibly using) some of the more interesting existing collaborative tools, and I imagine that one of the end products will be some sort of extension to the OpenID API, and a bunch of implementations so that we can use to connect the most interesting existing tools so that they work well together.
What exactly does the problem entail, and what exactly is the solution being proposed? I'm not sure yet, that's for us all to figure out together.
Hi Nathaniel,
ReplyDeleteI don't disagree that the Wikipedia method is simplistic and has its shortcomings. I'm sure a more clever method can be developed.
Building on other tools sounds like the right strategy. Will be interesting to watch this develop!
A birdie told me to look at http://www.cmu.edu/joss/content/articles/volume8/Welser/
ReplyDeleteIt seems highly relevant at first glance, and I'll be studying it in more detail later today.
To elaborate a little on the road map, I'm envisioning that this project might get into a kind of "non-monetary viral consulting business".
ReplyDeleteThe plan is to provide technical assistance to some of the other "massively collaborative thinkers", along the lines of finding simple ways of making their technology work better for the needs of their community.
What we'll get in return is attention. This will be useful in a number of ways, not least that it's an excellent way of attracting people who are interested in participating in this experimental project.
Gowers' project is one such potential "client", and Groklaw and Slashdot are also live possibilities in my thinking. However, there's no reason that we couldn't help out any healthy community which could benefit from assistance.
Michael Nielsen corrected my ignorance about the prior existence of self-aware online communities in response to my question. He also mentioned the idea of writing a book about "write a book about online community-building". Here, I'm thinking more along the lines of building an online index and resource on the subject.
RE: 'Liquidity of Trust'
ReplyDeleteI found this through one of Nielsen's links :
"I feel like such a fraud," she wrote on her profile. "Do you think dartmouth parents would be upset about paying $40,000 a year for their children to go here if they knew that certain professors were looking up stuff on Wikipedia and asking for advice from their Facebook friends on the night before the lecture?"
Her profile featured other comments as well, including a dig at her colleagues: "Some day, when i am chair, we're all going to JOG IN PLACE throughout the meeting. this should knock out at least half of the faculty within 10 minutes (especially the blowhards) & then the meeting can be ended in a timely manner."
====== (end quote; I haven't figured out how do format it in blogger -- blockquote isn't allowed)
This is the "dirty backside" of the liquidity of trust, the "liquidity of distrust". I think that messages of this kind (which had a detrimental effect on the professor's career when it was inadvertently made public) are vital to the health of a community, and that we'll need to provide appropriate mechanisms for the transmission of this sort of message.
Organized crime comes to online gaming.
ReplyDeleteFrom the article: "they could leverage that people trust this person and point them at various URLs, and those URLs will [ have malware ]"
This sort of misuse of trust is corrosive to any community, and I think there's ample evidence that it's going to be attempted in any sufficiently successful community.
Get in touch with for availability in your place.
ReplyDeleteThe cushion gives far more convenience mainly because it brings
in far more air. You can buy 2010 cheap Nike Air footwear if you appear carefully on line.
It will assist to make Nike air max one be a replacements of trend.
http://www.cheapairmaxcheap.co.uk/
Hello there! Do you use Twitter? I'd like to follow you if that would be okay. I'm undoubtedly enjoying your blog and look forward to new posts.
ReplyDeleteAlso visit my page - louis armstrong
Also see my web page - collection of louis vuitton mens
excellent post, very informative. I wonder why the other specialists of this sector
ReplyDeletedon't realize this. You must continue your writing. I am confident, you've a great
readers' base already!
Feel free to surf to my web blog :: discount christian louboutin
whoah this blog is fantastic i love studying your
ReplyDeleteposts. Stay up the good work! You understand, a lot of
people are looking round for this information, you can help them greatly.
Look into my site - オークリー サングラス
I know this web page offers quality dependent content and extra material, is
ReplyDeletethere any other web page which offers these information in quality?
Feel free to visit my site ... 眼鏡レイバン
Hi there just wanted to give you a quick heads up.
ReplyDeleteThe words in your content seem to be running off the screen
in Internet explorer. I'm not sure if this is a formatting issue or something to do with browser compatibility but I figured I'd post to let you know.
The layout look great though! Hope you get the problem solved soon.
Thanks
My web blog; ロレックスレプリカ
Hey There. I found your blog using msn. This is an extremely well written article.
ReplyDeleteI'll be sure to bookmark it and return to read more of your useful info. Thanks for the post. I will certainly return.
Feel free to surf to my website ... 45minutestomidnight.com
Ahaa, its pleasant discussion about this paragraph at this place
ReplyDeleteat this web site, I have read all that, so at this time me also commenting at this place.
Also visit my web site - ロレックスレプリカ
Hi there, i read your blog from time to time and i own a similar one and i was just wondering if you
ReplyDeleteget a lot of spam feedback? If so how do you reduce it, any plugin or anything you
can advise? I get so much lately it's driving me mad so any support is very much appreciated.
Feel free to surf to my web-site: レイバンサングラス
Greetings! Very helpful advice in this particular article!
ReplyDeleteIt is the little changes which will make the biggest changes.
Thanks for sharing!
Here is my weblog :: 激安レイバン
I am really thankful to the holder of this website who has shared this enormous article at
ReplyDeleteat this place.
Here is my website ... レイバンサングラス
This is a topic that's close to my heart... Take care! Exactly where are your contact details though?
ReplyDeleteAlso visit my web page ... www.aac.lv
Howdy I am so delighted I found your website, I really found you by error, while
ReplyDeleteI was looking on Digg for something else, Regardless I am here
now and would just like to say thank you for a marvelous post and a
all round exciting blog (I also love the theme/design), I don't have time to read it all at the minute but I have bookmarked it and also included your RSS feeds, so when I have time I will be back to read a great deal more, Please do keep up the excellent work.
Also visit my web blog ... レイバンサングラス
Hi! I could have sworn I've visited this web site before but after browsing through a few of the posts I realized it's new to me.
ReplyDeleteNonetheless, I'm definitely happy I found it and I'll be
book-marking it and checking back regularly!
my web-site; オークリー
These are in fact impressive ideas in about blogging.
ReplyDeleteYou have touched some fastidious points here. Any way keep up wrinting.
Take a look at my web site コーチ
When someone writes an paragraph he/she keeps the image of a user in his/her mind that how a user can understand it.
ReplyDeleteThus that's why this post is great. Thanks!
my web page; tanggukaisuo.cn
An agency investigation started a year ago found that the air bags discontinued 215 times, causing 81 minor
ReplyDeleteinjuries. He stars with Keri Russell inside Fox comedy Running Wilde.
Eau de Parfum or 'EDP' is next about the strength scale and usually contains 8% to 15% perfume oil.
Look into my webpage 2013louisvuittonhandbagsoutlettcc.com
Lava lamps that you buy use high heat and toxic chemicals, but you can come up with a lava lamp
ReplyDeletein the home using safe kitchen ingredients". "That piece just isn't included of their scientific studies. All in the children and mothers inside the study lived inside the Faroe Islands, located between Iceland and Scotland.
Also visit my web page; コーチ
One man demanded to have off, however the driver actually wouldn't permit him to without extra money. Promotional Pocket Calendars - Handy, Practical, and Useful. It requires a second and keeps your towel clean, mold-free, dry and pleasant for the next time you need it.
ReplyDeleteCheck out my page Louis Vuitton Purses
The best method to ensure how the online retailer you might be dealing with is
ReplyDeletereliable is to get feedbacks and knowledge from people who may have
dealt while using website. He said he hooked his first couple of attempts, but sent
his final effort soaring in the grandstand and between your cross bars.
Crop analysts have been lowering production estimates for corn and soybeans on a practically hourly basis, leading around what will be an historic government monthly crop report on August 10.
Look into my web-site - www.chanelbagguoutlet2013b.com
Snedeker shot a 6-under 65 on "Moving Day," and moved
ReplyDeleteup the leader board into second place despite losing a shot
to Mickelson. Simply could possibly get all over the come into experience of leaving your
neighborhood plumber enchanting offerings it they he
could be under have going to function as the thing your family members
are gonna want. Use your lead forms or even a small notebook
to record essentially the most vital information.
Feel free to visit my web-site; www.chanelkanku.com
Behind heavy security inside middle of Beverly Hills -- Jason.
ReplyDeleteAt the Chicago Board of Trade, soybeans for August delivery set a fresh record a lot of
$17. This can be resolved easily by searching for an ideal leather bags online.
Also visit my blog: www.chanelbagguoutlet2013e.com
Write more, thats all I have to say. Literally, it seems as though you relied on
ReplyDeletethe video to make your point. You definitely know what youre
talking about, why throw away your intelligence on just posting videos to your weblog when you could be giving us something enlightening to read?
My web blog - ミュウミュウ 財布
My partner and I absolutely love your blog and find most
ReplyDeleteof your post's to be what precisely I'm looking for. Does one
offer guest writers to write content available for you?
I wouldn't mind publishing a post or elaborating on a few of the subjects you write related to here. Again, awesome web log!
Look into my blog post :: ミュウミュウ 財布
For the reason that the admin of this web site is working, no hesitation very rapidly it
ReplyDeletewill be famous, due to its feature contents.
my web blog ... クロエ バッグ
Quality content is the main to interest the people to
ReplyDeletego to see the web site, that's what this web site is providing.
Feel free to surf to my page; nike air max
I was very pleased to find this website. I wanted to thank you
ReplyDeletefor ones time just for this fantastic read!! I definitely
liked every bit of it and i also have you bookmarked to look
at new things in your site.
Also visit my web-site - クリスチャンルブタン
@LaurenConrad awaken up @mtv has now JERSEY SHORE throw.
ReplyDelete.. Chanel also included one specific small, soft leather clutch in the collection
shown in green. The checkered pieces include a lunch box, tote and handbag.
Also consignment stores offer a wide limit of high
termination brands for incredibly affordable prices.
http://video.americanaddictthemovie.com/read_blog/8429/chanel-classic-quilted-flap-bag-in-lambskin
Thanks for the auspicious writeup. It in fact was a entertainment account it.
ReplyDeleteGlance complex to more delivered agreeable from you! However, how can we keep in touch?
my site tumblr.com
Excellent beat ! I wish to apprentice whilst you amend your site, how can i subscribe for a weblog website?
ReplyDeleteThe account aided me a appropriate deal. I had
been tiny bit acquainted of this your broadcast provided vibrant
clear idea
Look into my web page cheap nike air max free shipping
When some one searches for his essential thing,
ReplyDeletethus he/she needs to be available that in detail,
so that thing is maintained over here.
Review my site - cheap nike air max bw
Usually I do not read article on blogs, but I would like to say that this
ReplyDeletewrite-up very pressured me to try and do it! Your writing
taste has been amazed me. Thank you, quite nice post.
Also visit my weblog - http://www.developlinks.com
Hi there, I check your blogs regularly. Your story-telling
ReplyDeletestyle is awesome, keep up the good work!
Here is my blog post ... ヴィトンバッグ
Now the inventive way is in the protected fingers of Frida
ReplyDeleteGiannini. Are you a collector or opt to settle for a replica gucci bags?
? The dollars that you put in Gucci footwear is all really worth it.
Even though there are other colors, the black Guccissima leather bag is enjoying a big adhering to.
Have a look at my page: グッチ アウトレット
I don't even know how I ended up here, but I thought this post was good. I do not know who you are but certainly you're going to a famous blogger if you aren't already ;) Cheers!
ReplyDeleteHere is my weblog: Gucci 財布
But then, but do deer combined with other game.
ReplyDeleteIt is our perfect mixture of most light flowers with
the help of a noticeable cologne. Line-code of pastel stripes soon
is to the hallmark of the completely. It is a perfect mixture
together with light flowers with a noticeable cologne.
http://www.planetredo.com/GenieGrubb
Great blog! Is your theme custom made or did
ReplyDeleteyou download it from somewhere? A design like yours with a
few simple tweeks would really make my blog stand out.
Please let me know where you got your theme.
Appreciate it
My website; グッチ 長財布
I know this web site provides quality based content and other material, is there any
ReplyDeleteother website which gives these things in quality?
Feel free to visit my homepage: Nike air max billig
Its like you read my thoughts! You seem to grasp a lot approximately this, like you wrote the e-book in it
ReplyDeleteor something. I feel that you just could do with some % to force
the message home a bit, but other than that, this is great blog.
A fantastic read. I'll certainly be back.
Feel free to surf to my weblog ... Air max billig [www.realschuhe.com]
Unquestionably believe that that you stated. Your favorite justification appeared to be on the net the
ReplyDeletesimplest factor to have in mind of. I say to
you, I certainly get irked even as other folks consider issues that they plainly don't realize about.
You controlled to hit the nail upon the highest as well as defined out the whole thing with no need side-effects , other folks can take a
signal. Will probably be again to get more. Thanks
My web-site hay day cheats youtube
betmatik
ReplyDeletekralbet
betpark
tipobet
slot siteleri
kibris bahis siteleri
poker siteleri
bonus veren siteler
mobil ödeme bahis
JY6PK
betmatik
ReplyDeletekralbet
betpark
tipobet
slot siteleri
kibris bahis siteleri
poker siteleri
bonus veren siteler
mobil ödeme bahis
SAPFY4
betmatik
ReplyDeletekralbet
betpark
tipobet
slot siteleri
kibris bahis siteleri
poker siteleri
bonus veren siteler
mobil ödeme bahis
VQLH
betmatik
ReplyDeletekralbet
betpark
tipobet
slot siteleri
kibris bahis siteleri
poker siteleri
bonus veren siteler
mobil ödeme bahis
DNWTX
diyarbakır
ReplyDeletedüzce
edirne
elazığ
erzincan
EWL
شركة كشف تسربات المياه بالاحساء JEoaOMYpps
ReplyDeleteشركة كشف تسربات المياه بالدمام R6dU4YlBfU
ReplyDelete