Openssl Bad signature problem for Android 10

[tenwx]

xiaomi 8 pro android 10
TEESimulator-v3.0-46-b1a886d-Release

This error only occurs in Auto mode. When I switch to Force Generation Mode, everything worked fine.

[JingMatrix]

Please flash the debug CI builds and please upload logs as instructed here: #64 (comment)

[tenwx]

Please flash the debug CI builds and please upload logs as instructed here: #64 (comment)

The behavior remains the same even after using TEESimulator-v3.0-49-346cb7c-Release.
I checked the logs, but I couldn't find any particularly valuable information.

LSPosed_2026-01-27T22_19_48.849.zip

[VisionR1]

Maybe have the same like me:

#85 (comment)

[JingMatrix]

@tenwx You should flash the latest CI debug build of LSPosed.

[JingMatrix]

This should be been fixed by the latest commit.

[tenwx]

I used the TEESimulator-v3.0-49-d4ddfd9-Debug version, and the problem persists.

full.log

[JingMatrix]

@tenwx I need the LSPosed logs as indicated before, please follow closely my instruction.

[tenwx]

Sorry, I misunderstood before. This is my newly generated log, and it does look like there are some clues.

verbose_2026-01-28T22:54:25.362.log

[JingMatrix]

I only find the following part is relevant, for which please see my comments: #77 (comment)

[ 2026-01-28T22:54:57.590        0:  1506:  2633 I/TEESimulator    ] Parsing new key store file: /data/adb/tricky_store/keybox.xml
[ 2026-01-28T22:54:57.718        0:  1506:  2633 E/TEESimulator    ] Failed to parse PEM key pair.
org.bouncycastle.openssl.PEMException: problem parsing PRIVATE KEY: java.lang.IllegalArgumentException: unknown object in getInstance: org.bouncycastle.asn1.ASN1Integer
	at org.bouncycastle.openssl.PEMParser$PrivateKeyParser.parseObject(Unknown Source:35)
	at org.bouncycastle.openssl.PEMParser.readObject(Unknown Source:22)
	at org.matrix.TEESimulator.pki.CertificateHelper.parsePemKeyPair(CertificateHelper.kt:115)
	at org.matrix.TEESimulator.pki.KeyBoxManager.parseKeysFromXml(KeyBoxManager.kt:173)
	at org.matrix.TEESimulator.pki.KeyBoxManager.parseKeyStoreFile(KeyBoxManager.kt:99)
	at org.matrix.TEESimulator.pki.KeyBoxManager.getAttestationKey(KeyBoxManager.kt:55)
	at org.matrix.TEESimulator.attestation.AttestationPatcher.getKeyboxForUidAndAlgorithm(AttestationPatcher.kt:169)
	at org.matrix.TEESimulator.attestation.AttestationPatcher.patchCertificateChain(AttestationPatcher.kt:56)
	at org.matrix.TEESimulator.interception.keystore.KeystoreInterceptor.onPostTransact(KeystoreInterceptor.kt:300)
	at org.matrix.TEESimulator.interception.core.BinderInterceptor.handlePostTransact(BinderInterceptor.kt:183)
	at org.matrix.TEESimulator.interception.core.BinderInterceptor.onTransact(BinderInterceptor.kt:118)
	at android.os.Binder.execTransactInternal(Binder.java:1021)
	at android.os.Binder.execTransact(Binder.java:994)
Caused by: java.lang.IllegalArgumentException: unknown object in getInstance: org.bouncycastle.asn1.ASN1Integer
	at org.bouncycastle.asn1.ASN1Sequence.getInstance(Unknown Source:99)
	at org.bouncycastle.asn1.x509.AlgorithmIdentifier.getInstance(Unknown Source:11)
	at org.bouncycastle.asn1.pkcs.PrivateKeyInfo.<init>(Unknown Source:27)
	at org.bouncycastle.asn1.pkcs.PrivateKeyInfo.getInstance(Unknown Source:15)
	at org.bouncycastle.openssl.PEMParser$PrivateKeyParser.parseObject(Unknown Source:4)
	... 12 more
[ 2026-01-28T22:54:57.718        0:  1506:  2633 E/TEESimulator    ] Failed to parse a <Key> entry for algorithm 'rsa'
java.lang.ClassCastException: org.matrix.TEESimulator.pki.CertificateHelper$OperationResult$Error cannot be cast to org.matrix.TEESimulator.pki.CertificateHelper$OperationResult$Success
	at org.matrix.TEESimulator.pki.KeyBoxManager.parseKeysFromXml(KeyBoxManager.kt:173)
	at org.matrix.TEESimulator.pki.KeyBoxManager.parseKeyStoreFile(KeyBoxManager.kt:99)
	at org.matrix.TEESimulator.pki.KeyBoxManager.getAttestationKey(KeyBoxManager.kt:55)
	at org.matrix.TEESimulator.attestation.AttestationPatcher.getKeyboxForUidAndAlgorithm(AttestationPatcher.kt:169)
	at org.matrix.TEESimulator.attestation.AttestationPatcher.patchCertificateChain(AttestationPatcher.kt:56)
	at org.matrix.TEESimulator.interception.keystore.KeystoreInterceptor.onPostTransact(KeystoreInterceptor.kt:300)
	at org.matrix.TEESimulator.interception.core.BinderInterceptor.handlePostTransact(BinderInterceptor.kt:183)
	at org.matrix.TEESimulator.interception.core.BinderInterceptor.onTransact(BinderInterceptor.kt:118)
	at android.os.Binder.execTransactInternal(Binder.java:1021)
	at android.os.Binder.execTransact(Binder.java:994)
[ 2026-01-28T22:54:57.719        0:  1506:  2633 I/TEESimulator    ] Finished parsing, found 1 valid keys.

[JingMatrix]

Moreover, I noticed an Android 10 bug of LSPosed, and fixed it here: JingMatrix/LSPosed#521

Please update LSPosed, correct your keybox format and upload logs again.