From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RCVD_IN_DNSWL_NONE autolearn=ham autolearn_force=no version=3.4.4 Received: from tb-ob1.topicbox.com (tb-ob1.topicbox.com [64.147.108.173]) by inbox.vuxu.org (Postfix) with ESMTP id 503A330B85 for ; Wed, 30 Oct 2024 09:34:54 +0100 (CET) Received: from tb-mx1.topicbox.com (tb-mx1.nyi.icgroup.com [10.90.30.61]) by tb-ob1.topicbox.com (Postfix) with ESMTP id 8A1AE1B1F6 for ; Wed, 30 Oct 2024 04:34:53 -0400 (EDT) (envelope-from bounce.mMe195bb0082c187610dd28f76.r81958daa-7202-11ef-bbf2-18142b2d11b0@illumos.bounce.topicbox.com) Received: by tb-mx1.topicbox.com (Postfix, from userid 1132) id 8631C159E2B; Wed, 30 Oct 2024 04:34:53 -0400 (EDT) ARC-Authentication-Results: i=3; topicbox.com; arc=pass (as.1.strato.com=pass, ams.1.strato.com=pass) smtp.remote-ip=85.215.255.134; dkim=pass (2048-bit rsa key sha256) header.d=hoewweken.de header.i=@hoewweken.de header.b=BkTXaQvA header.a=rsa-sha256 header.s=strato-dkim-0002 x-bits=2048; dkim=pass (ed25519 key sha256) header.d=hoewweken.de header.i=@hoewweken.de header.b=JkyQnQTA header.a=ed25519-sha256 header.s=strato-dkim-0003; dmarc=none policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=duedinghausen.eu; spf=none smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu smtp.helo=mo4-p05-ob.smtp.rzone.de; x-internal-arc=fail (as.2.topicbox.com=pass, ams.2.topicbox.com=fail (message has been altered), as.1.strato.com=pass, ams.1.strato.com=fail (body has been altered)) (Message modified while forwarding at Topicbox) ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d= topicbox.com; h=message-id:date:mime-version:subject:to :references:from:in-reply-to:content-type :content-transfer-encoding:list-help:list-id:list-post :list-subscribe:reply-to:list-unsubscribe; s=sysmsg-1; t= 1730277293; bh=7Nr8wBTYhwaV1Vx28dm6Ni+9k+1D7STzMOz1cv5sbmI=; b=D H4G1LuOWRGARhLZd1SxCH9u/0ffrRN7+UNDEld0u41znnMvzbwqPjwXOlp5qBhXQ E8WuTTdKYeo5pKEzROfLk94sdp4kLMZFQ5X9CYjlJPMM4OJ6rYqgKdb89sqpHgFO Gn0EMqLCWyzkVCVBtNCMcGs00KzrolmTCWc+1zgnXU= ARC-Seal: i=3; a=rsa-sha256; cv=pass; d=topicbox.com; s=sysmsg-1; t= 1730277293; b=BsB238SDkJgTGE72dP0g/rjyQnVI58Qx3bUH3CpG56AOUDtYVJ w6TWOoAK/saQ+ZHOvO6VIIOIteKmyzTycm3PM9sHUmzEtFyM29HY6pouDXubackK ponLvAFIrTwKH2ypX6H3ZVYEVscURqjsDjIcf757ek8Ck08OJL7+C09Hk= Authentication-Results: topicbox.com; arc=pass (as.1.strato.com=pass, ams.1.strato.com=pass) smtp.remote-ip=85.215.255.134; dkim=pass (2048-bit rsa key sha256) header.d=hoewweken.de header.i=@hoewweken.de header.b=BkTXaQvA header.a=rsa-sha256 header.s=strato-dkim-0002 x-bits=2048; dkim=pass (ed25519 key sha256) header.d=hoewweken.de header.i=@hoewweken.de header.b=JkyQnQTA header.a=ed25519-sha256 header.s=strato-dkim-0003; dmarc=none policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=duedinghausen.eu; spf=none smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu smtp.helo=mo4-p05-ob.smtp.rzone.de; x-internal-arc=fail (as.2.topicbox.com=pass, ams.2.topicbox.com=fail (message has been altered), as.1.strato.com=pass, ams.1.strato.com=fail (body has been altered)) (Message modified while forwarding at Topicbox) X-Received-Authentication-Results: tb-mx1.topicbox.com; arc=pass (as.1.strato.com=pass, ams.1.strato.com=pass) smtp.remote-ip=85.215.255.134; bimi=skipped (DMARC did not pass); dkim=pass (2048-bit rsa key sha256) header.d=hoewweken.de header.i=@hoewweken.de header.b=BkTXaQvA header.a=rsa-sha256 header.s=strato-dkim-0002 x-bits=2048; dkim=pass (ed25519 key sha256) header.d=hoewweken.de header.i=@hoewweken.de header.b=JkyQnQTA header.a=ed25519-sha256 header.s=strato-dkim-0003; dmarc=none policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=duedinghausen.eu; iprev=pass smtp.remote-ip=85.215.255.134 (mo4-p05-ob.smtp.rzone.de); spf=none smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu smtp.helo=mo4-p05-ob.smtp.rzone.de; x-aligned-from=pass (Address match); x-me-sender=none; x-ptr=pass smtp.helo=mo4-p05-ob.smtp.rzone.de policy.ptr=mo4-p05-ob.smtp.rzone.de; x-return-mx=pass header.domain=duedinghausen.eu policy.is_org=yes (MX Records found: duedinghausen.eu); x-return-mx=pass smtp.domain=duedinghausen.eu policy.is_org=yes (MX Records found: duedinghausen.eu); x-tls=pass smtp.version=TLSv1.2 smtp.cipher=ECDHE-RSA-AES256-GCM-SHA384 smtp.bits=256/256; x-vs=clean score=0 state=0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=lists.illumos.org; h= message-id:date:mime-version:subject:to:references:from :in-reply-to:content-type:content-transfer-encoding:list-help :list-id:list-post:list-subscribe:reply-to:list-unsubscribe; s= dkim-1; t=1730277293; x=1730363693; bh=7Nr8wBTYhwaV1Vx28dm6Ni+9k +1D7STzMOz1cv5sbmI=; b=APY9YpI46KkSL0WINiNXa3yocJP+ePD011Tw++32c wJBl3b5fYj7tfYyVn519+1aCFbc/yzRcaJH7c8xChTSR6EyTRO+ZK+wv4asi8+1R HfQjoruoK48+m+wwRhk/OrvVNRFGnIKRFQe8fEo+eVrdQx/7RwrA6+MgL+QYcu+g 64= Received: from tb-mx1.topicbox.com (localhost.local [127.0.0.1]) by tb-mx1.topicbox.com (Postfix) with ESMTP id A5AB1159800 for ; Wed, 30 Oct 2024 04:32:22 -0400 (EDT) (envelope-from Stephan.Althaus@Duedinghausen.eu) Received: from tb-mx1.topicbox.com (localhost [127.0.0.1]) by tb-mx1.topicbox.com (Authentication Milter) with ESMTP id 6A4DEF68D8B; Wed, 30 Oct 2024 04:32:22 -0400 ARC-Seal: i=2; a=rsa-sha256; cv=pass; d=topicbox.com; s=arcseal; t= 1730277142; b=ZygHnwarCO5wcqIvM5PVM/p3KNCKMQ/T2CN7Id9ztSQ70qdBdt 5MuCdxx6ckbqzk1GybA215vYSw/6yMesXgLzEd76APmEcp1gW6Dl59KwH8mZnOhf MinRB8K5yTIsgQZofb45fIVsEK/6oxhGH0WSeLEQtIUM/+4gXOateDPcZsSS/EG3 q00eD/rqq4xsjFf4LTm35L8Wk/KqM92ExgpyAtl0QMtADzEvWvQqGJSfCKXUhTaT pReioy10yt8xBlx2DzF38O6Ci6bS7fQiOKFtq2kotD0ldvDN6Og78C1Axsvch/dy ubYclsSURQoVUXZK1C3AA/paT1hxWOHbQD1Q== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d= topicbox.com; h=message-id:date:mime-version:subject:to :references:from:in-reply-to:content-type :content-transfer-encoding; s=arcseal; t=1730277142; bh=WjJ78aJ5 iIOffDf7uC3JCEHOW2aeH3H4GM9DEjKVlGY=; b=V0QjP78NNcMGelZPLZUd2cSn va7kHmFm/mi4vTyG+ldTjEjB/ceiSLSuSj5nRdOcWULBC+yENxImMppg35/SphBZ f2zxXpemdW5sPVZwrnAbT4uZ+DlQ1KcHI/T/u+2vU8FjOF7x0tyO7UMzoYuL7E8Y TdqO0JxPhA9IfRg6i16jLvU9c7G4TKHrrKAdRM+wrO6flGDqxUZu1uAJGY2TX9uH OOte/IoPyiWn3hOmNCymtQNDat+Kr2ELz3q3hMOKU5f9Tx9/w8t/sslQ1jL94i8i OiY50mqu6DEa4cw/QbkNKOpH5arBqLunBEI0BWbL/viWcWab9zICGRZTTdKzDA== ARC-Authentication-Results: i=2; tb-mx1.topicbox.com; arc=pass (as.1.strato.com=pass, ams.1.strato.com=pass) smtp.remote-ip=85.215.255.134; bimi=skipped (DMARC did not pass); dkim=pass (2048-bit rsa key sha256) header.d=hoewweken.de header.i=@hoewweken.de header.b=BkTXaQvA header.a=rsa-sha256 header.s=strato-dkim-0002 x-bits=2048; dkim=pass (ed25519 key sha256) header.d=hoewweken.de header.i=@hoewweken.de header.b=JkyQnQTA header.a=ed25519-sha256 header.s=strato-dkim-0003; dmarc=none policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=duedinghausen.eu; iprev=pass smtp.remote-ip=85.215.255.134 (mo4-p05-ob.smtp.rzone.de); spf=none smtp.mailfrom=Stephan.Althaus@Duedinghausen.eu smtp.helo=mo4-p05-ob.smtp.rzone.de; x-aligned-from=pass (Address match); x-me-sender=none; x-ptr=pass smtp.helo=mo4-p05-ob.smtp.rzone.de policy.ptr=mo4-p05-ob.smtp.rzone.de; x-return-mx=pass header.domain=duedinghausen.eu policy.is_org=yes (MX Records found: duedinghausen.eu); x-return-mx=pass smtp.domain=duedinghausen.eu policy.is_org=yes (MX Records found: duedinghausen.eu); x-tls=pass smtp.version=TLSv1.2 smtp.cipher=ECDHE-RSA-AES256-GCM-SHA384 smtp.bits=256/256; x-vs=clean score=0 state=0 X-ME-VSCause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdekvddguddvudcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpggftfghnshhusghstghrihgsvgdp uffrtefokffrpgfnqfghnecuuegrihhlohhuthemuceftddtnecunecujfgurhepkfffgg gfuffvfhfhjggtgfesthekredttddvjeenucfhrhhomhepufhtvghphhgrnhcutehlthhh rghushcuoefuthgvphhhrghnrdetlhhthhgruhhsseffuhgvughinhhghhgruhhsvghnrd gvuheqnecuggftrfgrthhtvghrnhepffelfffgvdeutdehieffkeelkeeifeeifeeiieet jeevudduuedtteeviefgveefnecuffhomhgrihhnpehtohhpihgtsghogidrtghomhenuc fkphepkeehrddvudehrddvheehrddufeegnecuvehluhhsthgvrhfuihiivgeptdenucfr rghrrghmpehinhgvthepkeehrddvudehrddvheehrddufeegpdhhvghlohepmhhogedqph dthedqohgsrdhsmhhtphdrrhiiohhnvgdruggvpdhmrghilhhfrhhomhepoefuthgvphhh rghnrdetlhhthhgruhhsseffuhgvughinhhghhgruhhsvghnrdgvuheqpdhnsggprhgtph htthhopedupdhrtghpthhtohepoeguvghvvghlohhpvghrsehlihhsthhsrdhilhhluhhm ohhsrdhorhhgqe X-ME-VSScore: 0 X-ME-VSCategory: clean Received-SPF: none (duedinghausen.eu: No applicable sender policy available) receiver=tb-mx1.topicbox.com; identity=mailfrom; envelope-from="Stephan.Althaus@Duedinghausen.eu"; helo=mo4-p05-ob.smtp.rzone.de; client-ip=85.215.255.134 Received: from mo4-p05-ob.smtp.rzone.de (mo4-p05-ob.smtp.rzone.de [85.215.255.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tb-mx1.topicbox.com (Postfix) with ESMTPS for ; Wed, 30 Oct 2024 04:32:21 -0400 (EDT) (envelope-from Stephan.Althaus@Duedinghausen.eu) ARC-Seal: i=1; a=rsa-sha256; t=1730277140; cv=none; d=strato.com; s=strato-dkim-0002; b=OHeHYuiCivVhTFVDw+6Vt4a7E+SmK3QRtSTGRF8jtc2XGSxkJ8zcqOZZGu7XFP6h8V eETeBlHbSYesu7J1TWT/jQ3FXOfUKbGT7qMCh0MTeJkZUkgsR/jeXq9bP1cknzpvIXza cYwVv5u7rFI6H2o6ZfgOefmkT0cYsgEEDuaA0pFueInLxtmTF1uFdpcGL8F1uDmIsMN0 945tsX1jPgB45D/IJQ+40M9YWHQbvqsGNjpCS8m+mh9DKJn1OUuWP3pFXGRCekd4Cgbc xVkIIT11PFeBeF+EtNthX2YNBi2BUgN9vc29MmjEmv1o26OlqN0D/f6+Oj7JPBH1mDkn qjGg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; t=1730277140; s=strato-dkim-0002; d=strato.com; h=In-Reply-To:From:References:To:Subject:Date:Message-ID:Cc:Date:From: Subject:Sender; bh=WjJ78aJ5iIOffDf7uC3JCEHOW2aeH3H4GM9DEjKVlGY=; b=gMyVnc8QUh/3AL7XOkok+E6SuGDF0YDNP5yLPVw1SBtBacDIgcC4XViJQSYBe/4Ghy 7VuJ+PewOG4di9HzdZeuUgyR9guF/zw3rLVjlYvAEBAOjxO0JcgK6FxJaRJ5fEH3aHZB kfcO5oH9y5s0aR30rg/YslA5+CQ8qpvcNfuXzu0as7Yp4BHRmG8HtWpkGmmjI9dbCDty TrV8opGZcCFyFT/9xu0CXWqKMWLE3OI0AivRZI0GT2hnTAS1tnaySdi7VL54oeYbGhBP Vl4R1fXSaFowk+MEASv82bLcJXIISOOdSpsogMcCgLazjSl1wZnD5jMO7VWoBMAR/9pz 6s2g== ARC-Authentication-Results: i=1; strato.com; arc=none; dkim=none X-RZG-AUTH: ":O2kGeEG7b/pS1EW2TmikjLDsYYueHLp2aWg0q38nsxvThUrH35SBpgREu1WSr02W+X6BTF0=" X-RZG-CLASS-ID: mo05 Received: from www.duedinghausen.eu by smtp.strato.de (RZmta 51.2.11 DYNA|AUTH) with ESMTPSA id qd219d09U8WJ19h (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits)) (Client did not present a certificate) for ; Wed, 30 Oct 2024 09:32:19 +0100 (CET) Received: from [192.168.2.63] (speedport.ip [192.168.1.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) (Authenticated sender: steven) by www.duedinghausen.eu (Postfix) with ESMTPSA id 05252B1182 for ; Wed, 30 Oct 2024 09:31:44 +0100 (CET) Message-ID: Date: Wed, 30 Oct 2024 09:32:20 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [developer] Re: illumos/uefi-edk2 update 2023-11 To: developer@lists.illumos.org References: <86402a35-7a29-4834-90b4-9dde14378237@Duedinghausen.eu> <17077493090.3fA493c4f.212448@composer.illumos.topicbox.com> <7c43f7f5-64d5-4087-b9b6-ccb8f558264b@Duedinghausen.eu> Content-Language: en-US From: Stephan Althaus In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Topicbox-Policy-Reasoning: allow: sender is a member Topicbox-Message-UUID: 7f980634-9699-11ef-b67c-a7c1a5c9e2fb Archived-At: =?UTF-8?B?PGh0dHBzOi8vaWxsdW1vcy50b3BpY2JveC5jb20vZ3JvdXBz?= =?UTF-8?B?L2RldmVsb3Blci9UMGU3MWRhZDBiYzE3MzI5YS1NZTE5NWJiMDA4MmMxODc2?= =?UTF-8?B?MTBkZDI4Zjc2Pg==?= List-Help: List-Id: "illumos-developer" List-Post: List-Software: Topicbox v0 List-Subscribe: Precedence: list Reply-To: illumos-developer List-Unsubscribe: , Topicbox-Delivery-ID: 2:illumos:a901537c-2aea-11e7-965f-d98f9f16e227:81958daa-7202-11ef-bbf2-18142b2d11b0:Me195bb0082c187610dd28f76:1:Wtdc9BamWppx_7rZvuq-fC61hufJ-XPCVwHAVV_6woo On 10/29/24 16:25, Stephan Althaus wrote: > Hi All! > > I thought i'd try out a GPU passthrough on OI to a Windows vm with=20 > bhyve again. > > This time it is an AMD RX 6400, and i verified the System settings=20 > with FreeBSD 4.1, there the GPU is working, so the BIOS settings and=20 > the GPU-ROM are ok. > > The VM startscripts and data are within a NVME zpool, so that i can=20 > switch to OI easily and have the same with FrreBSD and OI. > > When i enable immu-intrmap-enable=3D"true"; in=20 > /platform/i86pc/kernel/drv/rootnex.conf > this leads to error messages when i start the bhyve test script with=20 > messages > APIC ERROR Interrupt on CPU 0. Status 0 =3D 0 Status 1 =3D 40. > on the console and the system is not responsive anymore.. > > When i leave it toimmu-intrmap-enable=3D" false", the Windows vm starts=20 > and the GPU has error 43 within the device-manager. > > What can i do to see where the APIC error comes from ? some dtrace=20 > script maybe ? > > Any help is appreciated. > > Regards, > Stephan > > P.S. The test command: > > /usr/sbin/bhyve -U bd60bf59-0ed6-61a1-f0ed-b17e99ada165 -A -H \ > -B=20 > 1,manufacturer=3DOpenIndiana,product=3DOpenIndianaHVM,version=3D1.0,seria= l=3D69a18a85-c1df-c266-f620-a99a632d3c11,sku=3D001,family=3DVirtualMachine= =20 > \ > -c 4 -m 16G -w \ > -s 31:0,lpc -l bootrom,/home2/vm/BHYVE_UEFI.fd \ > -s 0,hostbridge,model=3Di440fx=C2=A0 \ > -s 4:0,nvme,/dev/zvol/rdsk/home2/vm/win10vol \ > -s 6:0,virtio-net-viona,vnic0 \ > -s 7:0,ahci-cd,/home2/vm/virtio-win-0.1.240.iso \ > -s 30:0,fbuf,tcp=3D0.0.0.0:5905,w=3D1920,h=3D1080 \ > -s 30:1,xhci,tablet \ > -S \ > -s 8:0,passthru,/dev/ppt0,rom=3D/home2/vm/Navi24.rom \ > -s 8:1,passthru,/dev/ppt1 \ > win10 > > $ pptadm > DEV=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 VENDOR DEVICE PATH > /dev/ppt0=C2=A0 1002=C2=A0=C2=A0 743f=20 > /pci@7a,0/pci8086,6f08@3/pci1002,1478@0/pci1002,1479@0/display@0 > /dev/ppt1=C2=A0 1002=C2=A0=C2=A0 ab28=20 > /pci@7a,0/pci8086,6f08@3/pci1002,1478@0/pci1002,1479@0/pci1002,ab28@0,1 > > > On 2/16/24 10:29, Stephan Althaus wrote: >> Hello! >> >> Small update on this.. >> >> The goal i want to achieve is to have a GPU passthrough on OI to a=20 >> Windows vm with bhyve... >> >> I now tested linux/proxmox (kvm)=C2=A0 and FreeBSD 14 (bhyve) with=20 >> success, so i can assume the Hardware and the BIOS settings are ok. >> >> FreeBSD has this version of the edk2 image: >> >> $ pkg search edk2 >> edk2-bhyve-g202308_4=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 EDK2 Firmware for bhyve >> >> .. so version 202311 seems not to be needed (?) >> >> What i see if i try it on OI, is that >> >> immu-intrmap-enable=3D"true"; >> >> in >> >> /platform/i86pc/kernel/drv/rootnex.conf >> >> leads to error messages when i start the bhyve test script with messages >> APIC ERROR Interrupt on CPU 0. Status 0 =3D 0 Status 1 =3D 40. >> on the console and the system is not responsive anymore.. >> >> >> Do i _need_ immu-intrmap-enable=3D"true"; ? >> >> >> I currently have these values set: >> >> immu-enable=3D"true"; >> #immu-intrmap-enable=3D"true"; >> immu-blacklist=3D >> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 "SMBIOS","Supermicro","X10DRI-T","" >> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 ; >> immu-dvma-mapping=3D"xlate"; >> immu-dvma-unity-drivers=3D"igb","ahci","ixgbe","ehci","xhci","nvme"; >> immu-dvma-xlate-drivers=3D"mpt"; >> >> Is anyone around with a success story who has been there and done that ? >> >> >> i want to passtrough this: >> >> $ pptadm list -o all >> DEV=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 VENDOR DEVICE SUBVENDOR SU= BDEVICE REV=20 >> PATH=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 LABEL >> /dev/ppt0=C2=A0 1002=C2=A0=C2=A0 743f=C2=A0=C2=A0 1da2=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 e458=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 c7=20 >> /pci@7a,0/pci8086,6f08@3/pci1002,1478@0/pci1002,1479@0/display@0=20 >> Advanced Micro Devices, Inc. [AMD/ATI] Navi 24 [Radeon RX 6400/6500=20 >> XT/6500M] >> /dev/ppt1=C2=A0 1002=C2=A0=C2=A0 ab28=C2=A0=C2=A0 1002=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 ab28=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0=20 >> /pci@7a,0/pci8086,6f08@3/pci1002,1478@0/pci1002,1479@0/pci1002,ab28@0,1= =20 >> Advanced Micro Devices, Inc. [AMD/ATI] Navi 21/23 HDMI/DP Audio=20 >> Controller >> >> ... using this test script: >> >> $ /usr/sbin/bhyve -U bd60bf59-0ed6-61a1-f0ed-b17e99ada165 -A -H \ >> -B=20 >> 1,manufacturer=3DOpenIndiana,product=3DOpenIndianaHVM,version=3D1.0,seri= al=3D69a18a85-c1df-c266-f620-a99a632d3c11,sku=3D001,family=3DVirtualMachine= =20 >> \ >> -c 4 -m 16G -w \ >> -s 31:0,lpc -l bootrom,/usr/share/bhyve/firmware/BHYVE.fd,fwcfg=3Dqemu \ >> -s 0,hostbridge,model=3Di440fx=C2=A0 \ >> -s 4:0,nvme,/dev/zvol/rdsk/home2/vm/win10vol \ >> -s 6:0,virtio-net-viona,vnic0 \ >> -s 30:0,fbuf,vga=3Doff,tcp=3D0.0.0.0:5905 \ >> -s 30:1,xhci,tablet \ >> -S -s 8:0,passthru,/dev/ppt0,rom=3D/home2/vm/Navi24.rom \ >> -s 8:1,passthru,/dev/ppt1 \ >> win10 >> >> The GPU can be seen within the vm (error 43), it seems the card=20 >> doesn't get initialized.. >> >> Any hints are welcome.. >> >> >> Regards, >> >> Stephan >> >> >> >> ------------------------------------------ >> illumos: illumos-developer >> Permalink:=20 >> https://illumos.topicbox.com/groups/developer/T0e71dad0bc17329a-M6350209= 90ad99de8499b28ad >> Delivery options:=20 >> https://illumos.topicbox.com/groups/developer/subscription > > > > ------------------------------------------ > illumos: illumos-developer > Permalink:=20 > https://illumos.topicbox.com/groups/developer/T0e71dad0bc17329a-M54c5f6bf= 883f52445dbaedfd > Delivery options:=20 > https://illumos.topicbox.com/groups/developer/subscription Hi! I tested the move of the vm data to a SATA drive, removed the nvme=20 drive, but the APIC Interrupt errors persist. Which additional drivers of the 168 used $ modinfo |awk '{print $6}'|sort -u|wc =C2=A0=C2=A0=C2=A0=C2=A0 168=C2=A0=C2=A0=C2=A0=C2=A0 168=C2=A0=C2=A0=C2=A0= 1146 =C2=A0do i have to blacklist in rootnex.conf ?? Anyone BTDT ? Here's some messages-output that may be of interest: user@smhost:~$ grep DMAR /var/adm/messages |grep "8:5 > ^C user@smhost:~$ grep DMAR /var/adm/messages |grep "8:5" Oct 30 08:52:24 smhost acpica: [ID 137418 kern.notice] ACPI: DMAR=20 0x0000000079F05458 000138 (v01 ALASKA A M I=C2=A0=C2=A0=C2=A0 00000001 INTL= 20091013) Oct 30 08:52:24 smhost genunix: [ID 958256 kern.info] Processing DMAR=20 ACPI table Oct 30 08:52:24 smhost genunix: [ID 680212 kern.notice] NOTICE: DMAR=20 ACPI table: skipping unsupported unit type ATSR Oct 30 08:52:24 smhost genunix: [ID 533727 kern.notice] NOTICE: DMAR=20 ACPI table: skipping unsupported unit type RHSA user@smhost:~$ grep iomm /var/adm/messages |grep "8:5" Oct 30 08:52:24 smhost iommulib: [ID 321598 kern.info] NOTICE:=20 iommulib_nexus_register: rootnex-1: Succesfully registered NEXUS i86pc=20 nexops=3Dfffffffffbd30040 Oct 30 08:52:24 smhost genunix: [ID 970263 kern.info] iommu0: unit setup Oct 30 08:52:24 smhost genunix: [ID 970279 kern.info] iommu1: unit setup Oct 30 08:52:24 smhost genunix: [ID 466022 kern.info] iommu0: creating=20 domainid arena iommu0_domainid_arena Oct 30 08:52:24 smhost genunix: [ID 160421 kern.info] iommu1: creating=20 domainid arena iommu1_domainid_arena Oct 30 08:52:24 smhost genunix: [ID 733261 kern.info] isa0: iommu: Found=20 LPC device Oct 30 08:52:24 smhost genunix: [ID 969345 kern.info] isa0: iommu:=20 iommu1-domain-2-xlate-DVMA-arena: Creating dvma vmem arena [0x1000 -=20 0x9a000] Oct 30 08:52:24 smhost genunix: [ID 331729 kern.info] isa0: iommu:=20 iommu1-domain-2-xlate-DVMA-arena: Adding dvma vmem span [0x100000 -=20 0x79034000] Oct 30 08:52:24 smhost genunix: [ID 325630 kern.info] isa0: iommu:=20 iommu1-domain-2-xlate-DVMA-arena: Adding dvma vmem span [0x100000000 -=20 0x2080000000] Oct 30 08:52:24 smhost genunix: [ID 352456 kern.info] vgatext: iommu:=20 Found GFX device Oct 30 08:52:24 smhost genunix: [ID 137511 kern.info] ppt: iommu: Found=20 GFX device Oct 30 08:52:24 smhost genunix: [ID 664311 kern.notice] NOTICE: iommu0=20 running Oct 30 08:52:24 smhost iommulib: [ID 345192 kern.info] NOTICE:=20 iommulib_register: iommu0: Detected IOMMU registration from vendor Intel Oct 30 08:52:24 smhost iommulib: [ID 643661 kern.info] NOTICE:=20 iommulib_register: iommu0: Succesfully registered IOMMU unit from=20 vendor=3DIntel, ops=3Dfffffeb1ae8dad80, data=3Dfffffeb1ae136b00, IOMMULIB u= nitid=3D1 Oct 30 08:52:24 smhost genunix: [ID 341888 kern.notice] NOTICE: iommu1=20 running Oct 30 08:52:24 smhost iommulib: [ID 345192 kern.info] NOTICE:=20 iommulib_register: iommu1: Detected IOMMU registration from vendor Intel Oct 30 08:52:24 smhost iommulib: [ID 643661 kern.info] NOTICE:=20 iommulib_register: iommu1: Succesfully registered IOMMU unit from=20 vendor=3DIntel, ops=3Dfffffeb1ae8dad20, data=3Dfffffeb1ae136880, IOMMULIB u= nitid=3D2 Oct 30 08:52:24 smhost amd_iommu: [ID 251261 kern.info] NOTICE:=20 amd_iommu: No AMD IOMMU ACPI IVRS table Regards, Stephan ------------------------------------------ illumos: illumos-developer Permalink: https://illumos.topicbox.com/groups/developer/T0e71dad0bc17329a-= Me195bb0082c187610dd28f76 Delivery options: https://illumos.topicbox.com/groups/developer/subscription