From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Original-To: caml-list@sympa.inria.fr Delivered-To: caml-list@sympa.inria.fr Received: from mail3-relais-sop.national.inria.fr (mail3-relais-sop.national.inria.fr [192.134.164.104]) by sympa.inria.fr (Postfix) with ESMTPS id C60D57F164 for ; Sun, 6 Mar 2016 20:53:06 +0100 (CET) IronPort-PHdr: 9a23:vKvDIReVY7i74PPWgCoMucSClGMj4u6mDksu8pMizoh2WeGdxc6+bR7h7PlgxGXEQZ/co6odzbGG7Oa/CCdZu8fJmUtBWaIPfidNsd8RkQ0kDZzNImzAB9muURYHGt9fXkRu5XCxPBsdMs//Y1rPvi/6tmZKSV3BPAZ4bt74BpTVx5zukbvipNuMMk4R3mv1SIgxBSv1hD2ZjtMRj4pmJ/R54TryiVwMRd5rw3h1L0mYhRf265T41pdi9yNNp6BprJYYAu2pN5g/GLdRCTBjN2Eu+OXqswPCRE2B/CgySGITxyRJBQPI6g2yfJ76qzb3raIpxiicNsDwUZgqWDKp4qF3DR3hgz4aOiV/9mzL3J8jxJlHqQ6s8kQsi7XfZ5uYYaJz Authentication-Results: mail3-smtp-sop.national.inria.fr; spf=None smtp.pra=jacquev6@gmail.com; spf=Pass smtp.mailfrom=jacquev6@gmail.com; spf=None smtp.helo=postmaster@mail-qk0-f176.google.com Received-SPF: None (mail3-smtp-sop.national.inria.fr: no sender authenticity information available from domain of jacquev6@gmail.com) identity=pra; client-ip=209.85.220.176; receiver=mail3-smtp-sop.national.inria.fr; envelope-from="jacquev6@gmail.com"; x-sender="jacquev6@gmail.com"; x-conformance=sidf_compatible Received-SPF: Pass (mail3-smtp-sop.national.inria.fr: domain of jacquev6@gmail.com designates 209.85.220.176 as permitted sender) identity=mailfrom; client-ip=209.85.220.176; receiver=mail3-smtp-sop.national.inria.fr; envelope-from="jacquev6@gmail.com"; x-sender="jacquev6@gmail.com"; x-conformance=sidf_compatible; x-record-type="v=spf1" Received-SPF: None (mail3-smtp-sop.national.inria.fr: no sender authenticity information available from domain of postmaster@mail-qk0-f176.google.com) identity=helo; client-ip=209.85.220.176; receiver=mail3-smtp-sop.national.inria.fr; envelope-from="jacquev6@gmail.com"; x-sender="postmaster@mail-qk0-f176.google.com"; x-conformance=sidf_compatible X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A0DTAQBYitxWlrDcVdFdFoN2bQaoNIF/kBOCCocFBzoSAQEBAQEBAQEQAQEBAQcNCQkhL0ESAYFZgi0RHQE5Aw0FAwYBBjcCJBIBBQE9EweHawMSDpM7jTqCB4ExPjGLNoRBhRAnDYRrAQUKBIURijuCNIE6BZcqgSOEQIgKY4FLjEyNFxEegQ8PGAtlgQ2CIzsuAYECiDoBAQE X-IPAS-Result: A0DTAQBYitxWlrDcVdFdFoN2bQaoNIF/kBOCCocFBzoSAQEBAQEBAQEQAQEBAQcNCQkhL0ESAYFZgi0RHQE5Aw0FAwYBBjcCJBIBBQE9EweHawMSDpM7jTqCB4ExPjGLNoRBhRAnDYRrAQUKBIURijuCNIE6BZcqgSOEQIgKY4FLjEyNFxEegQ8PGAtlgQ2CIzsuAYECiDoBAQE X-IronPort-AV: E=Sophos;i="5.22,547,1449529200"; d="scan'208,217";a="167324868" Received: from mail-qk0-f176.google.com ([209.85.220.176]) by mail3-smtp-sop.national.inria.fr with ESMTP/TLS/AES128-GCM-SHA256; 06 Mar 2016 20:53:05 +0100 Received: by mail-qk0-f176.google.com with SMTP id x1so39880976qkc.1 for ; Sun, 06 Mar 2016 11:53:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to; bh=kND1u3M+i/iqcFsfnzaVcCOpDEuR71FrZDZ7KfbKIIo=; b=H6x22TycCqg6gKBPEO/tMjX9ORP14pHXiXb9yokiZavg5Qwm3lyIgv4cW+BI9EQp6P 7PY58pKPbCggX1/qt3sp9enB8pkbu06fAJW5k06Uzo+5nqIBYs3wwrVK7O09Addb9oFU 6maAtBPBnoKornhqtzwtQXXFjAbtMNeW4a02Z5fdWeqib6Cbub+u+2SbH8h1Kf8gFpnr JNDm3Qf3ZpAUVlZO/gRP98CT5CMbxfdVvJdrXuajCst8XYnMFs4xZ1hhyS05QlFFDFFf wl6x5QG+Gz46ab3MUAbKqoIdB7sKbiVSnJ9Pdg7Ku/z8PU8pms90i+n1qZ/6tAe+bNAD u5eQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:date:message-id:subject:from :to; bh=kND1u3M+i/iqcFsfnzaVcCOpDEuR71FrZDZ7KfbKIIo=; b=XYqNvWnouOIAI9b2OrR8ZXOgPLyXfKrpLFOLqPCMLUyGwscdqaQFQ+oL36SUtoZlk8 Jy2xYzK74YNX48wFzF/w/f2mqNd2y9IEqY1Fj829TPAvIkPHGx3pq0mM5rHEgPWoc5yO lIn63QYo18BYHkMVYyg9mnRdH4vrRTbIdHPK0Z7gJmyJuG38eY5hfIm/Oyy9E5QryFUr Lk6R7L45HkH7Q0AHtU+CKojvqJl5DKC2QDrR7hO//ncJL45WkeXxqzC5/AY7Ygs2W9T2 4P8e2WuFLDFINMHqcDYr+wDMsZzeF9+bZSQgg+q1RMt5MmC1yiGAILYKZ13C5ExBUIDI lG6Q== X-Gm-Message-State: AD7BkJJrkE7+KUhCA8EqBd1+QIFjnQytvGYqSpa8uaCaCZ9fx3fEiRK4xNukcvMrGkCoAJahM8GhFPZZ71RuJA== MIME-Version: 1.0 X-Received: by 10.55.71.76 with SMTP id u73mr24764112qka.6.1457293984354; Sun, 06 Mar 2016 11:53:04 -0800 (PST) Sender: jacquev6@gmail.com Received: by 10.55.36.133 with HTTP; Sun, 6 Mar 2016 11:53:04 -0800 (PST) Date: Sun, 6 Mar 2016 20:53:04 +0100 X-Google-Sender-Auth: ie8V9I9W-4owye20QEezqF0Iy9o Message-ID: From: Vincent Jacques To: caml-list@inria.fr Content-Type: multipart/alternative; boundary=001a114a8012455924052d66b2e8 X-Validation-by: vincent@vincent-jacques.net Subject: [Caml-list] Test coverage of generated lexers/parsers --001a114a8012455924052d66b2e8 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hello, Does somebody have experience measuring test coverage of generated lexers/parsers? I'm using ocamllex/ocamlyacc [1] (but I can switch to Menhir [2]) to generate a lexer/parser. In my tests, I simply check that some input strings give the ASTs I expect. I usually use Bisect [3] to make sure that my tests cover the code I intended to cover, but in that configuration, Bisect is lost between the .mll/.mly files and the generated .ml files and produces useless reports. How would you measure test coverage in that case? Thanks, [1] http://caml.inria.fr/pub/docs/manual-ocaml/lexyacc.html [2] http://gallium.inria.fr/~fpottier/menhir/ [3] http://bisect.x9c.fr/ --=20 Vincent Jacques http://vincent-jacques.net "S'il n'y a pas de solution, c'est qu'il n'y a pas de probl=C3=A8me" Devise Shadock --001a114a8012455924052d66b2e8 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hello,

Does somebody have experience mea= suring test coverage of generated lexers/parsers?

I'm using ocam= llex/ocamlyacc [1] (but I can switch to Menhir [2]) to generate a lexer/par= ser. In my tests, I simply check that some input strings give the ASTs I ex= pect.

I usually use Bisect [3] to make sure tha= t my tests cover the code I intended to cover, but in that configuration, B= isect is lost between the .mll/.mly files and the generated .ml files and p= roduces useless reports.

How would you measure test cover= age in that case?

Thanks,
--001a114a8012455924052d66b2e8--