You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-19 - 00:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Sat Oct 18, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21980994040,0cyclictest5729-21fwupd09:05:070
21990991918,1cyclictest60250irq/125-lan11:10:372
21990991918,1cyclictest60250irq/125-lan07:59:582
21990991717,0cyclictest60250irq/125-lan11:30:162
21990991717,0cyclictest60250irq/125-lan10:15:162
21990991717,0cyclictest60250irq/125-lan10:06:032
21990991717,0cyclictest60250irq/125-lan09:59:172
21990991717,0cyclictest60250irq/125-lan09:35:522
21990991717,0cyclictest60250irq/125-lan09:10:492
21990991717,0cyclictest60250irq/125-lan07:30:192
21990991717,0cyclictest60250irq/125-lan07:20:002
21990991716,1cyclictest60250irq/125-lan11:55:152
21990991716,1cyclictest60250irq/125-lan08:50:172
21990991716,1cyclictest60250irq/125-lan08:20:412
21990991716,1cyclictest60250irq/125-lan08:00:412
21990991716,1cyclictest60250irq/125-lan07:42:402
21990991616,0cyclictest60250irq/125-lan11:16:062
21990991616,0cyclictest60250irq/125-lan08:55:172
21990991615,1cyclictest60250irq/125-lan12:30:162
21990991615,1cyclictest60250irq/125-lan12:20:132
21990991615,1cyclictest60250irq/125-lan11:45:112
21990991615,1cyclictest60250irq/125-lan09:45:132
21990991615,1cyclictest60250irq/125-lan09:30:152
21990991615,1cyclictest60250irq/125-lan09:25:232
21990991615,1cyclictest60250irq/125-lan09:15:152
21990991615,1cyclictest60250irq/125-lan09:05:012
21995991515,0cyclictest329-21hwrng12:05:543
21995991515,0cyclictest329-21hwrng12:02:503
21995991515,0cyclictest329-21hwrng11:58:433
21995991515,0cyclictest329-21hwrng11:26:583
21995991515,0cyclictest329-21hwrng11:07:323
21995991515,0cyclictest329-21hwrng10:35:473
21995991515,0cyclictest329-21hwrng10:34:463
21995991515,0cyclictest329-21hwrng10:27:353
21995991515,0cyclictest329-21hwrng10:14:163
21995991515,0cyclictest329-21hwrng10:07:073
21995991515,0cyclictest329-21hwrng09:59:563
21995991515,0cyclictest329-21hwrng08:57:283
21995991515,0cyclictest329-21hwrng08:28:483
21995991515,0cyclictest329-21hwrng08:08:193
21995991515,0cyclictest329-21hwrng07:43:453
21995991515,0cyclictest329-21hwrng07:22:143
21990991515,0cyclictest60250irq/125-lan09:20:162
21990991514,1cyclictest60250irq/125-lan11:20:182
21990991514,1cyclictest60250irq/125-lan10:25:152
21990991514,1cyclictest60250irq/125-lan09:50:212
21990991514,1cyclictest60250irq/125-lan08:40:212
21986991515,0cyclictest329-21hwrng12:25:211
21986991515,0cyclictest329-21hwrng12:11:011
21986991515,0cyclictest329-21hwrng11:54:381
21986991515,0cyclictest329-21hwrng11:09:351
21986991515,0cyclictest329-21hwrng10:39:531
21986991515,0cyclictest329-21hwrng08:55:251
21986991515,0cyclictest329-21hwrng07:25:191
21980991515,0cyclictest329-21hwrng07:10:590
21995991414,0cyclictest329-21hwrng12:22:173
21995991414,0cyclictest329-21hwrng11:46:273
21995991414,0cyclictest329-21hwrng11:30:043
21995991414,0cyclictest329-21hwrng11:22:543
21995991414,0cyclictest329-21hwrng11:15:443
21995991414,0cyclictest329-21hwrng11:01:233
21995991414,0cyclictest329-21hwrng10:57:173
21995991414,0cyclictest329-21hwrng10:24:323
21995991414,0cyclictest329-21hwrng10:16:203
21995991414,0cyclictest329-21hwrng10:00:593
21995991414,0cyclictest329-21hwrng08:53:233
21995991414,0cyclictest329-21hwrng08:32:553
21995991414,0cyclictest329-21hwrng08:10:223
21995991414,0cyclictest329-21hwrng07:45:493
21990991414,0cyclictest60250irq/125-lan11:35:252
21990991414,0cyclictest60250irq/125-lan10:30:142
21990991414,0cyclictest60250irq/125-lan10:10:152
21990991414,0cyclictest60250irq/125-lan10:00:152
21990991414,0cyclictest60250irq/125-lan08:32:422
21990991414,0cyclictest60250irq/125-lan08:18:512
21990991414,0cyclictest60250irq/125-lan07:45:232
21990991413,1cyclictest60250irq/125-lan12:35:242
21990991413,1cyclictest60250irq/125-lan11:50:172
21990991413,1cyclictest60250irq/125-lan11:00:252
21990991413,1cyclictest60250irq/125-lan10:40:152
21990991413,1cyclictest60250irq/125-lan09:00:182
21990991413,1cyclictest60250irq/125-lan08:25:202
21990991413,1cyclictest60250irq/125-lan07:10:152
21986991414,0cyclictest329-21hwrng12:07:571
21986991414,0cyclictest329-21hwrng10:58:181
21986991414,0cyclictest329-21hwrng09:58:551
21986991414,0cyclictest329-21hwrng09:25:071
21986991414,0cyclictest329-21hwrng09:00:341
21986991414,0cyclictest329-21hwrng08:14:281
21986991414,0cyclictest329-21hwrng08:02:111
21986991414,0cyclictest329-21hwrng07:58:051
21986991414,0cyclictest329-21hwrng07:54:001
21995991313,0cyclictest329-21hwrng07:14:033
21990991313,0cyclictest60250irq/125-lan07:50:392
21990991312,1cyclictest60250irq/125-lan12:00:212
21990991312,1cyclictest60250irq/125-lan08:10:162
21990991312,1cyclictest60250irq/125-lan07:15:152
21986991313,0cyclictest329-21hwrng12:36:371
21986991313,0cyclictest329-21hwrng11:49:301
21986991313,0cyclictest329-21hwrng11:37:141
21986991313,0cyclictest329-21hwrng11:20:511
21986991313,0cyclictest329-21hwrng10:50:081
21986991313,0cyclictest329-21hwrng09:49:421
21986991313,0cyclictest329-21hwrng09:21:021
21986991313,0cyclictest329-21hwrng09:16:571
21986991313,0cyclictest329-21hwrng09:10:471
21986991313,0cyclictest329-21hwrng08:45:121
21986991313,0cyclictest329-21hwrng08:40:041
21986991313,0cyclictest329-21hwrng07:38:391
21986991313,0cyclictest329-21hwrng07:32:301
21986991313,0cyclictest329-21hwrng07:17:071
21986991312,0cyclictest329-21hwrng09:35:231
21990991212,0cyclictest60250irq/125-lan12:25:252
21990991212,0cyclictest60250irq/125-lan10:20:242
21990991212,0cyclictest60250irq/125-lan08:35:462
21990991211,1cyclictest60250irq/125-lan12:10:162
21990991211,1cyclictest60250irq/125-lan07:25:142
21986991212,0cyclictest329-21hwrng12:30:281
21986991212,0cyclictest329-21hwrng11:11:381
21986991212,0cyclictest329-21hwrng11:03:251
21986991212,0cyclictest329-21hwrng10:49:051
21986991212,0cyclictest329-21hwrng10:21:271
21986991212,0cyclictest329-21hwrng10:08:091
21986991212,0cyclictest329-21hwrng09:50:441
21986991212,0cyclictest329-21hwrng09:44:351
21986991212,0cyclictest329-21hwrng09:05:411
21986991212,0cyclictest329-21hwrng08:35:591
21986991212,0cyclictest329-21hwrng08:20:381
21986991212,0cyclictest329-21hwrng07:24:181
21986991212,0cyclictest329-21hwrng07:10:591
21990991111,0cyclictest60250irq/125-lan10:46:422
21990991110,1cyclictest60250irq/125-lan08:45:182
21986991111,0cyclictest329-21hwrng10:10:101
21986991111,0cyclictest329-21hwrng08:15:291
2199099109,1cyclictest60250irq/125-lan11:05:252
21990991010,0cyclictest60250irq/125-lan11:40:222
219909999,0cyclictest60250irq/125-lan12:16:162
219909999,0cyclictest60250irq/125-lan10:50:232
219909998,1cyclictest60250irq/125-lan09:40:122
219909998,1cyclictest60250irq/125-lan08:05:192
219869999,0cyclictest329-21hwrng08:50:191
219809998,1cyclictest702-21snmpd09:16:580
219809998,1cyclictest702-21snmpd07:37:290
219959988,0cyclictest702-21snmpd11:43:163
219959988,0cyclictest702-21snmpd07:26:433
219809987,1cyclictest702-21snmpd12:17:140
219809987,1cyclictest702-21snmpd11:10:460
219809987,1cyclictest702-21snmpd08:16:590
219959977,0cyclictest702-21snmpd09:54:193
219959977,0cyclictest702-21snmpd09:42:423
219959977,0cyclictest702-21snmpd07:30:083
219959976,1cyclictest702-21snmpd10:54:333
219959976,1cyclictest702-21snmpd09:20:533
219959976,1cyclictest702-21snmpd08:45:253
219959972,2cyclictest0-21swapper/307:39:593
219909977,0cyclictest60250irq/125-lan07:35:162
219909976,1cyclictest60250irq/125-lan11:25:162
219909976,1cyclictest60250irq/125-lan10:55:192
219909976,1cyclictest60250irq/125-lan10:35:182
219869977,0cyclictest329-21hwrng07:41:421
219809977,0cyclictest702-21snmpd12:31:300
219809977,0cyclictest702-21snmpd11:26:080
219809977,0cyclictest702-21snmpd09:56:150
219809977,0cyclictest702-21snmpd09:44:180
219809977,0cyclictest702-21snmpd09:14:070
219809977,0cyclictest702-21snmpd09:02:190
219809977,0cyclictest702-21snmpd08:37:370
219809977,0cyclictest702-21snmpd07:55:110
219809977,0cyclictest702-21snmpd07:17:040
219809976,1cyclictest702-21snmpd12:27:010
219809976,1cyclictest702-21snmpd12:04:290
219809976,1cyclictest702-21snmpd10:57:430
219959966,0cyclictest702-21snmpd12:38:553
219959966,0cyclictest702-21snmpd09:11:493
219959963,1cyclictest171rcu_preempt09:25:173
219959963,0cyclictest171rcu_preempt12:35:003
219959963,0cyclictest171rcu_preempt10:44:593
219959963,0cyclictest171rcu_preempt08:35:193
219959963,0cyclictest171rcu_preempt07:55:153
219959962,1cyclictest171rcu_preempt11:10:193
219959960,3cyclictest44-21ksoftirqd/312:15:173
219869966,0cyclictest702-21snmpd12:19:091
219869966,0cyclictest702-21snmpd10:27:161
219869966,0cyclictest329-21hwrng10:40:541
219869965,1cyclictest702-21snmpd09:32:401
219869965,1cyclictest702-21snmpd07:48:211
219809966,0cyclictest702-21snmpd11:43:500
219809966,0cyclictest702-21snmpd09:30:540
219809966,0cyclictest702-21snmpd08:59:550
219809966,0cyclictest702-21snmpd08:23:190
219809966,0cyclictest329-21hwrng08:25:440
219809965,1cyclictest702-21snmpd11:32:010
219809965,1cyclictest702-21snmpd11:03:150
219809965,1cyclictest702-21snmpd10:51:240
219809965,1cyclictest702-21snmpd10:17:040
219809965,1cyclictest702-21snmpd08:49:180
219809965,1cyclictest702-21snmpd08:07:060
219809965,1cyclictest702-21snmpd07:54:060
219809960,6cyclictest11582-21turbostat10:40:000
219959954,1cyclictest10648-21cpuspeed_turbos08:00:123
219959954,1cyclictest10536-21netstat09:15:163
219959953,0cyclictest171rcu_preempt09:45:173
219959952,1cyclictest171rcu_preempt09:30:213
219959952,0cyclictest171rcu_preempt11:35:203
219959950,3cyclictest0-21swapper/310:50:003
219959950,2cyclictest0-21swapper/308:24:483
219909954,1cyclictest60250irq/125-lan12:05:162
219869954,1cyclictest702-21snmpd12:21:221
219869954,1cyclictest702-21snmpd12:00:591
219869954,1cyclictest702-21snmpd11:26:381
219869954,1cyclictest702-21snmpd10:30:501
219869950,2cyclictest3028-21users10:15:211
219809955,0cyclictest702-21snmpd10:12:580
219809955,0cyclictest702-21snmpd09:39:220
219809955,0cyclictest702-21snmpd07:49:590
219809955,0cyclictest702-21snmpd07:40:280
219809954,1cyclictest702-21snmpd11:20:190
219809954,1cyclictest702-21snmpd10:06:500
219809954,1cyclictest702-21snmpd07:20:200
219809954,1cyclictest22317-21gltestperf11:05:160
219809953,2cyclictest702-21snmpd12:13:330
219809950,5cyclictest5493-21dump-pmu-power10:25:000
219959944,0cyclictest329-21hwrng12:25:213
219959941,1cyclictest171rcu_preempt12:10:183
219959941,1cyclictest171rcu_preempt09:05:143
219959941,1cyclictest171rcu_preempt08:40:123
219959941,1cyclictest171rcu_preempt07:50:203
219959940,3cyclictest0-21swapper/308:15:183
219959940,2cyclictest0-21swapper/309:35:153
219959940,2cyclictest0-21swapper/309:00:173
219959940,2cyclictest0-21swapper/307:15:183
219869942,2cyclictest702-21snmpd08:33:281
219869942,2cyclictest13404-21ntpq08:05:241
219869940,2cyclictest26746-21gltestperf11:15:161
219869940,1cyclictest4545-21basename11:40:161
219869940,1cyclictest0-21swapper/110:01:171
219809944,0cyclictest329-21hwrng12:38:400
219809944,0cyclictest329-21hwrng11:45:240
219809944,0cyclictest329-21hwrng11:35:110
219809944,0cyclictest329-21hwrng10:47:020
219809944,0cyclictest329-21hwrng10:42:580
219809944,0cyclictest329-21hwrng10:32:420
219809944,0cyclictest329-21hwrng09:46:370
219809944,0cyclictest329-21hwrng09:27:100
219809944,0cyclictest329-21hwrng08:51:210
219809944,0cyclictest329-21hwrng08:40:040
219809944,0cyclictest329-21hwrng08:33:550
219809944,0cyclictest329-21hwrng07:31:270
219809944,0cyclictest329-21hwrng07:25:190
219809943,1cyclictest702-21snmpd12:05:360
219809943,1cyclictest702-21snmpd08:10:140
219809942,2cyclictest11151-21needreboot08:00:140
219959930,1cyclictest171rcu_preempt11:50:153
219869932,1cyclictest10382-21df_inode11:55:121
219869930,2cyclictest0-21swapper/108:25:171
219869930,0cyclictest0-21swapper/111:30:151
219809933,0cyclictest329-21hwrng11:57:430
219809932,1cyclictest707-21runrttasks11:18:230
219809932,1cyclictest702-21snmpd09:50:460
219809932,1cyclictest702-21snmpd09:20:390
219809932,1cyclictest0-21swapper/012:20:130
219809931,2cyclictest8191-21awk11:50:140
219809931,2cyclictest28699-21needreboot10:00:160
219809930,2cyclictest6612-21ntp_states10:25:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional