You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-26 - 17:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1.osadl.org (updated Sun May 26, 2024 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
50839920564,140cyclictest0-21swapper/210:24:522
50909915343,22cyclictest0-21swapper/710:23:057
50769913874,0cyclictest0-21swapper/010:24:430
50869912828,99cyclictest0-21swapper/410:23:054
50869911464,1cyclictest24709-21snmp_nas.osadl.10:24:454
508599111107,3cyclictest2453-21openvpn10:24:453
50859910926,61cyclictest43-21ksoftirqd/310:24:253
5078999937,61cyclictest0-21swapper/110:23:031
5089999835,1cyclictest24973-21mingetty10:24:526
5089999795,1cyclictest0-21swapper/610:23:056
5076996260,1cyclictest190550irq/25-eth010:22:590
5090995957,1cyclictest24304-21bash10:24:457
507899596,52cyclictest213650irq/32-eth2-TxR10:24:521
5088995452,1cyclictest7401-21login10:23:035
5083995352,0cyclictest13950irq/24-ahci[00010:23:052
5088994038,1cyclictest0-21swapper/510:24:475
507899360,1cyclictest0-21swapper/108:19:521
5076993214,16cyclictest30044-21perl11:09:440
5088993129,1cyclictest893-40kipmi011:04:515
5086993129,1cyclictest0-21swapper/410:54:094
5090993014,14cyclictest9317-21perl10:55:517
5086993028,1cyclictest0-21swapper/412:24:164
508699300,1cyclictest0-21swapper/410:11:164
5088992927,1cyclictest893-40kipmi012:24:475
5086992927,1cyclictest0-21swapper/410:45:194
5086992927,1cyclictest0-21swapper/410:30:484
5076992916,11cyclictest13069-21ssh11:39:590
508699280,27cyclictest0-21swapper/411:00:014
5088992725,1cyclictest6274-21kworker/5:011:17:335
508699270,26cyclictest0-21swapper/411:52:014
508699270,25cyclictest0-21swapper/411:39:544
508699266,18cyclictest6389-21perl11:56:094
5076992613,1cyclictest190550irq/25-eth007:55:530
5088992523,1cyclictest15928-21kworker/5:210:44:375
5088992422,1cyclictest30727-21kworker/5:010:09:575
5086992422,1cyclictest0-21swapper/410:39:184
508699237,1cyclictest9212-21perl10:55:494
5086992315,7cyclictest12881-21perl09:56:114
5083992319,2cyclictest13950irq/24-ahci[00008:13:202
507899230,8cyclictest25203-21G112:39:401
509099221,2cyclictest3405-21perl11:54:487
509099221,2cyclictest29681-21perl11:09:407
509099221,2cyclictest17345-21perl07:10:147
5089992218,2cyclictest27314-21perl12:09:516
508999221,19cyclictest13621-21perl11:54:326
508999220,20cyclictest18749-21QueuingRrdStrat09:57:556
5086992212,9cyclictest555-21md0_raid107:49:564
5086992212,4cyclictest7738-21kworker/4:111:07:594
508699221,19cyclictest0-21swapper/407:56:024
508599221,19cyclictest27270-21perl07:55:503
507899220,21cyclictest0-21swapper/111:54:471
507699223,17cyclictest4347-21perl07:10:060
509099211,2cyclictest22445-21perl07:40:057
509099211,2cyclictest22445-21perl07:40:057
509099210,19cyclictest5500-21perl09:39:317
509099210,19cyclictest5500-21perl09:39:317
509099210,19cyclictest0-21swapper/707:55:417
5089992117,3cyclictest18446-21perl08:56:056
5089992117,2cyclictest4718-21perl09:09:456
5089992117,2cyclictest0-21swapper/610:10:026
5088992119,1cyclictest61-21ksoftirqd/510:55:235
5086992119,1cyclictest0-21swapper/411:29:564
5086992118,2cyclictest8330-21perl08:40:044
508699211,2cyclictest29673-21perl11:09:404
508699210,19cyclictest0-21swapper/408:56:114
508599213,16cyclictest0-21swapper/311:09:403
5085992119,1cyclictest893-40kipmi008:19:523
508599211,1cyclictest5954-21perl11:55:563
508599210,2cyclictest20081-21perl10:10:023
5083992117,2cyclictest18065-21perl09:55:052
508399211,18cyclictest27713-21perl12:09:592
5078992119,1cyclictest0-21swapper/111:04:511
507899210,1cyclictest17233-21perl10:55:131
509099201,2cyclictest3404-21perl08:40:077
509099201,17cyclictest27792-21perl12:09:597
5089992017,2cyclictest26659-21perl07:55:106
508999201,2cyclictest27417-21perl08:09:566
5086992018,1cyclictest0-21swapper/409:02:164
5086992018,1cyclictest0-21swapper/409:02:164
5086992017,2cyclictest52-21ksoftirqd/409:09:484
5086992016,2cyclictest18050-21perl09:39:334
5086992016,2cyclictest18050-21perl09:39:334
5086992015,4cyclictest0-21swapper/407:34:284
5086992015,4cyclictest0-21swapper/407:34:284
5085992017,2cyclictest8195-21perl08:10:003
508599200,2cyclictest29060-21perl07:40:053
508599200,2cyclictest29060-21perl07:40:053
5083992017,2cyclictest19367-21ssh09:59:592
5083992015,3cyclictest0-21swapper/209:09:462
508399200,1cyclictest0-21swapper/211:55:562
507899204,15cyclictest3028-21postmaster10:10:091
507899200,1cyclictest0-21swapper/111:21:011
507899200,1cyclictest0-21swapper/109:56:571
507899200,1cyclictest0-21swapper/107:55:551
507899200,19cyclictest0-21swapper/107:40:161
507899200,19cyclictest0-21swapper/107:40:161
507699207,12cyclictest0-21swapper/007:17:270
5076992016,2cyclictest3632-21perl10:10:170
509099191,2cyclictest4720-21perl09:09:457
509099190,17cyclictest16399-21perl08:54:517
509099190,17cyclictest11769-21ssh09:55:067
5089991917,1cyclictest32210-21kworker/6:009:20:026
5089991917,1cyclictest32210-21kworker/6:008:03:306
5089991917,1cyclictest13049-21kworker/6:111:07:096
5089991915,2cyclictest17330-21perl07:10:126
5088991917,1cyclictest8423-21kworker/5:211:59:355
5088991917,1cyclictest6235-21kworker/5:207:05:085
5088991917,1cyclictest61-21ksoftirqd/509:09:475
5088991917,1cyclictest28765-21kworker/5:209:57:235
5088991917,1cyclictest28765-21kworker/5:209:39:315
5088991917,1cyclictest28765-21kworker/5:209:39:315
5088991917,1cyclictest19771-21kworker/5:007:55:145
5088991917,1cyclictest18920-21kworker/5:009:18:505
5088991917,1cyclictest18920-21kworker/5:008:46:185
5088991917,1cyclictest17787-21kworker/5:012:04:355
5088991917,1cyclictest16745-21kworker/5:007:12:245
5088991917,1cyclictest15928-21kworker/5:210:52:155
5088991916,2cyclictest28765-21kworker/5:209:37:555
5088991916,1cyclictest8423-21kworker/5:211:58:195
5086991917,1cyclictest0-21swapper/410:40:314
5086991917,1cyclictest0-21swapper/410:40:314
5086991913,5cyclictest0-21swapper/408:14:404
508699191,2cyclictest3097-21perl07:10:064
508699190,18cyclictest0-21swapper/411:45:374
508699190,17cyclictest27798-21perl12:09:594
5085991915,2cyclictest21728-21perl08:55:213
5085991915,2cyclictest17171-21perl07:10:053
508599191,2cyclictest9289-21perl10:55:493
5083991916,2cyclictest17287-21perl07:10:102
5083991915,2cyclictest8540-21postmaster10:55:242
5083991915,2cyclictest27094-21perl07:55:352
5078991917,1cyclictest0-21swapper/112:24:471
507899190,3cyclictest16570-21sshd09:17:321
5076991916,2cyclictest8376-21perl10:55:210
5076991915,2cyclictest5124-21perl11:55:200
5076991913,4cyclictest16399-21perl08:54:510
507699190,17cyclictest0-21swapper/009:57:550
5089991816,1cyclictest10389-21perl11:09:386
5089991815,2cyclictest8701-21perl10:55:306
5088991816,1cyclictest6701-21kworker/5:108:14:405
5088991816,1cyclictest6701-21kworker/5:108:10:025
5088991816,1cyclictest6274-21kworker/5:011:19:355
5088991816,1cyclictest6235-21kworker/5:207:03:385
5088991816,1cyclictest4196-21kworker/5:211:40:055
5088991816,1cyclictest28765-21kworker/5:209:49:095
5088991816,1cyclictest25630-21kworker/5:011:50:355
5088991816,1cyclictest19771-21kworker/5:008:00:325
5088991816,1cyclictest18920-21kworker/5:008:54:565
5088991816,1cyclictest18920-21kworker/5:008:53:445
5088991816,1cyclictest16745-21kworker/5:007:14:525
5088991816,1cyclictest15928-21kworker/5:210:41:195
5088991816,1cyclictest15928-21kworker/5:210:41:195
5088991815,2cyclictest6274-21kworker/5:011:31:055
5086991814,3cyclictest8082-21perl08:10:024
5086991814,2cyclictest52-21ksoftirqd/407:28:314
5086991813,4cyclictest0-21swapper/409:49:554
5086991810,7cyclictest2453-21openvpn09:30:044
508699180,17cyclictest0-21swapper/412:24:494
5085991815,2cyclictest3987-21pool-13-thread-09:09:393
5085991815,2cyclictest3532-21perl08:40:073
5085991815,2cyclictest27829-21perl12:09:593
508599181,16cyclictest2453-21openvpn09:55:073
5083991816,1cyclictest0-21swapper/211:09:392
5083991815,2cyclictest3548-21perl10:10:142
5083991814,3cyclictest893-40kipmi009:39:462
5083991814,3cyclictest893-40kipmi009:39:462
5078991815,2cyclictest10406-21perl11:09:381
507899180,16cyclictest18437-21perl08:56:031
5076991815,2cyclictest3982-21postmaster09:09:420
5076991814,2cyclictest2725-21nscd12:09:570
507699180,1cyclictest0-21swapper/007:53:450
509099175,6cyclictest25604-21JNI-ICMP-3226-S09:47:457
5089991714,2cyclictest12111-21postmaster07:40:056
5089991714,2cyclictest12111-21postmaster07:40:056
5088991715,1cyclictest32181-21kworker/5:010:30:435
5088991715,1cyclictest29796-21kworker/5:007:37:265
5088991715,1cyclictest29796-21kworker/5:007:29:505
5088991715,1cyclictest29796-21kworker/5:007:29:505
5088991715,1cyclictest29796-21kworker/5:007:24:485
5088991715,1cyclictest28765-21kworker/5:210:06:535
5088991715,1cyclictest28765-21kworker/5:209:30:285
5088991715,1cyclictest24078-21kworker/5:207:24:225
5088991715,1cyclictest18920-21kworker/5:009:24:105
5088991715,1cyclictest17787-21kworker/5:012:17:215
5088991715,1cyclictest17787-21kworker/5:012:12:155
5088991715,1cyclictest15928-21kworker/5:211:11:075
5088991715,1cyclictest15928-21kworker/5:210:59:535
5088991715,1cyclictest11241-21kworker/5:207:42:485
5088991715,1cyclictest11241-21kworker/5:207:42:485
508699178,7cyclictest0-21swapper/410:00:574
508699178,4cyclictest0-21swapper/408:51:384
508699171,2cyclictest26912-21pool-13-thread-09:04:584
5085991712,2cyclictest0-21swapper/310:30:553
5083991714,2cyclictest14354-21QueuingRrdStrat08:55:192
5083991713,3cyclictest27088-21JNI-ICMP-12079-11:53:252
5078991715,1cyclictest2453-21openvpn09:09:441
5078991715,1cyclictest0-21swapper/111:17:331
507899170,1cyclictest8260-21perl08:10:041
509099163,12cyclictest0-21swapper/710:13:067
509099161,13cyclictest25245-21GC12:39:407
509099161,10cyclictest25604-21JNI-ICMP-3226-S11:47:407
5089991613,2cyclictest17598-21sadc09:39:286
5089991612,2cyclictest26351-21Poller-Thread-210:17:026
508999161,13cyclictest25245-21GC12:39:406
508999161,13cyclictest25244-21GC12:39:406
508999161,13cyclictest14789-21sh11:40:576
5088991614,1cyclictest6274-21kworker/5:011:25:495
5088991614,1cyclictest4196-21kworker/5:211:48:595
5088991614,1cyclictest32181-21kworker/5:010:34:455
5088991614,1cyclictest30727-21kworker/5:010:15:095
5088991614,1cyclictest28765-21kworker/5:210:00:495
5088991614,1cyclictest28765-21kworker/5:209:49:475
5088991614,1cyclictest18920-21kworker/5:009:04:345
5088991614,1cyclictest18920-21kworker/5:008:59:425
5088991614,1cyclictest18920-21kworker/5:008:59:425
5088991614,1cyclictest18920-21kworker/5:008:43:265
5088991614,1cyclictest18920-21kworker/5:008:36:365
5088991614,1cyclictest18920-21kworker/5:008:27:125
5088991614,1cyclictest17787-21kworker/5:012:19:415
5088991613,1cyclictest4196-21kworker/5:211:39:235
5088991613,1cyclictest11241-21kworker/5:207:45:045
5088991613,1cyclictest11241-21kworker/5:207:45:045
508699166,5cyclictest0-21swapper/408:36:004
5086991612,1cyclictest0-21swapper/407:21:204
5086991611,4cyclictest26717-21Collectd-Thread08:27:404
5086991611,4cyclictest0-21swapper/409:45:204
508699161,13cyclictest25249-21GC12:39:404
508699161,13cyclictest25245-21GC12:39:404
5086991610,5cyclictest0-21swapper/412:03:374
5086991610,5cyclictest0-21swapper/411:36:354
5086991610,3cyclictest12-21rcu_sched09:16:324
508599161,13cyclictest25249-21GC12:39:403
508599161,13cyclictest25249-21GC12:39:403
508599161,13cyclictest25248-21GC12:39:403
508599161,13cyclictest25247-21GC12:39:403
508599161,13cyclictest25246-21GC12:39:403
508599161,13cyclictest25245-21GC12:39:403
5083991613,2cyclictest14746-21postmaster10:39:552
5083991613,2cyclictest14746-21postmaster10:39:552
508399161,13cyclictest25247-21GC12:39:402
508399161,13cyclictest25247-21GC12:39:402
508399161,13cyclictest25246-21GC12:39:402
508399160,1cyclictest0-21swapper/211:44:462
508399160,15cyclictest25246-21GC12:39:402
5078991613,2cyclictest26192-21snmpd10:31:401
5078991613,2cyclictest16479-21postmaster10:39:541
5078991613,2cyclictest16479-21postmaster10:39:541
5078991613,1cyclictest0-21swapper/109:44:401
5078991612,2cyclictest0-21swapper/108:34:441
5076991613,2cyclictest190550irq/25-eth008:09:550
507699161,13cyclictest25247-21GC12:39:400
507699161,13cyclictest25246-21GC12:39:400
507699161,13cyclictest25243-21GC12:39:400
507699160,13cyclictest25245-21GC12:39:400
509099154,5cyclictest25604-21JNI-ICMP-3226-S11:37:427
509099153,9cyclictest25925-21JNI-ICMP-25227-10:43:147
509099153,9cyclictest25925-21JNI-ICMP-25227-10:43:147
509099151,13cyclictest25245-21GC12:39:407
509099150,14cyclictest18907-21munin-run07:49:297
509099150,14cyclictest18907-21munin-run07:49:297
509099150,13cyclictest25249-21GC12:39:407
509099150,13cyclictest25248-21GC12:39:407
509099150,13cyclictest25244-21GC12:39:407
509099150,13cyclictest25201-21GC12:39:407
509099150,13cyclictest0-21swapper/710:31:507
5089991513,1cyclictest26192-21snmpd07:18:396
5089991512,2cyclictest16566-21cat08:19:476
5089991512,2cyclictest0-21swapper/608:08:546
508999151,12cyclictest25244-21GC12:39:406
508999150,14cyclictest20087-21diskmemload12:03:566
508999150,13cyclictest25249-21GC12:39:406
508999150,13cyclictest25249-21GC12:39:406
508999150,13cyclictest25246-21GC12:39:406
508999150,13cyclictest25244-21GC12:39:406
5088991513,1cyclictest6701-21kworker/5:108:19:485
5088991513,1cyclictest28765-21kworker/5:209:24:505
5088991513,1cyclictest19771-21kworker/5:008:05:225
5088991513,1cyclictest19771-21kworker/5:007:51:125
5088991513,1cyclictest18920-21kworker/5:008:32:445
508699158,5cyclictest50-21rcuc/410:16:414
5086991513,1cyclictest26192-21snmpd08:20:544
5086991513,1cyclictest26192-21snmpd07:44:244
5086991513,1cyclictest26192-21snmpd07:44:244
5086991513,1cyclictest0-21swapper/408:45:564
5086991513,1cyclictest0-21swapper/408:30:404
5086991512,2cyclictest25246-21GC12:39:404
5086991512,2cyclictest0-21swapper/407:44:364
5086991512,2cyclictest0-21swapper/407:44:364
5086991512,2cyclictest0-21swapper/407:05:084
5086991512,1cyclictest0-21swapper/412:04:354
508699151,13cyclictest25249-21GC12:39:404
5086991510,3cyclictest52-21ksoftirqd/407:18:244
508699150,13cyclictest25244-21GC12:39:404
5085991512,2cyclictest26317-21Poller-Thread-208:04:453
5085991512,1cyclictest0-21swapper/309:00:553
5085991512,1cyclictest0-21swapper/309:00:553
508599151,12cyclictest25247-21GC12:39:403
508599151,12cyclictest25244-21GC12:39:403
508599150,14cyclictest0-21swapper/312:15:273
508599150,13cyclictest25244-21GC12:39:403
508599150,13cyclictest13626-21sendmail10:17:533
5083991512,2cyclictest26192-21snmpd09:38:552
5083991512,2cyclictest18914-21sadc09:19:292
508399151,12cyclictest25249-21GC12:39:402
508399151,12cyclictest25247-21GC12:39:402
508399151,12cyclictest25245-21GC12:39:402
5083991511,2cyclictest0-21swapper/210:18:272
508399150,13cyclictest25243-21GC12:39:402
508399150,13cyclictest18749-21QueuingRrdStrat09:25:472
5078991513,1cyclictest0-21swapper/109:22:551
507899150,13cyclictest0-21swapper/109:04:461
507899150,13cyclictest0-21swapper/108:44:531
507899150,13cyclictest0-21swapper/108:29:441
507699154,6cyclictest25609-21JNI-ICMP-2463-S10:52:500
507699154,5cyclictest25928-21JNI-ICMP-10383-11:52:060
507699150,13cyclictest25244-21GC12:39:400
507699150,13cyclictest18050-21perl09:39:340
507699150,13cyclictest18050-21perl09:39:340
509099144,6cyclictest25609-21JNI-ICMP-2463-S11:54:257
509099143,6cyclictest27088-21JNI-ICMP-12079-12:28:517
509099143,6cyclictest25925-21JNI-ICMP-25227-10:05:507
509099143,6cyclictest25618-21JNI-ICMP-20956-10:37:117
509099143,6cyclictest25609-21JNI-ICMP-2463-S10:15:347
509099142,6cyclictest25925-21JNI-ICMP-25227-12:03:357
5090991412,1cyclictest26192-21snmpd08:47:247
5090991410,2cyclictest26329-21Poller-Thread-709:35:057
5090991410,2cyclictest24008-21sadc08:29:287
509099140,1cyclictest0-21swapper/711:30:117
509099140,1cyclictest0-21swapper/709:49:557
509099140,13cyclictest25243-21GC12:39:407
509099140,12cyclictest25248-21GC12:39:407
509099140,12cyclictest213450irq/30-eth2-TxR09:25:167
508999143,5cyclictest25604-21JNI-ICMP-3226-S08:30:116
5089991413,0cyclictest29809-21kworker/6:011:18:596
5089991412,1cyclictest26192-21snmpd10:46:266
5089991411,2cyclictest5496-21perl09:39:316
5089991411,2cyclictest5496-21perl09:39:316
508999141,12cyclictest25247-21GC12:39:406
508999140,13cyclictest25246-21GC12:39:406
508699146,6cyclictest52-21ksoftirqd/408:08:044
508699146,3cyclictest52-21ksoftirqd/407:38:524
5086991411,2cyclictest26615-21Collectd-Thread07:02:244
5086991410,2cyclictest0-21swapper/410:07:214
508699140,12cyclictest25244-21GC12:39:404
508599146,4cyclictest17669-21pool-14-thread-07:14:523
508599144,5cyclictest27088-21JNI-ICMP-12079-10:06:483
508599143,6cyclictest25925-21JNI-ICMP-25227-07:23:113
508599143,5cyclictest25934-21JNI-ICMP-23182-09:28:073
508599142,6cyclictest25925-21JNI-ICMP-25227-09:31:093
508599142,5cyclictest25618-21JNI-ICMP-20956-07:29:473
508599142,5cyclictest25618-21JNI-ICMP-20956-07:29:473
5085991411,2cyclictest31168-21perl11:39:593
5085991411,2cyclictest26192-21snmpd10:59:563
5085991411,1cyclictest11140-21snmp_nas.osadl.07:04:453
508599140,1cyclictest0-21swapper/309:49:483
508599140,1cyclictest0-21swapper/309:40:403
508599140,1cyclictest0-21swapper/309:40:403
508599140,12cyclictest25248-21GC12:39:403
508599140,12cyclictest25248-21GC12:39:403
508599140,12cyclictest25245-21GC12:39:403
508599140,12cyclictest25245-21GC12:39:403
508399149,4cyclictest0-21swapper/207:03:282
508399146,3cyclictest25618-21JNI-ICMP-20956-08:45:482
508399143,5cyclictest25925-21JNI-ICMP-25227-11:26:532
508399141,8cyclictest27088-21JNI-ICMP-12079-09:03:282
508399141,8cyclictest27088-21JNI-ICMP-12079-09:03:282
5083991412,1cyclictest26192-21snmpd07:25:242
5083991411,2cyclictest26192-21snmpd07:07:242
508399141,11cyclictest0-21swapper/212:04:452
5083991411,0cyclictest0-21swapper/211:15:392
508399140,1cyclictest0-21swapper/210:44:462
508399140,13cyclictest25243-21GC12:39:402
508399140,13cyclictest0-21swapper/209:21:102
5078991413,0cyclictest241ktimersoftd/111:39:531
5078991412,1cyclictest32585-21sadc10:09:291
5078991412,1cyclictest26192-21snmpd12:22:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional