You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 11:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Sun Nov 23, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3197991818,0cyclictest60250irq/125-lan21:19:572
3197991818,0cyclictest60250irq/125-lan00:14:132
3197991817,1cyclictest60250irq/125-lan23:10:012
3197991817,1cyclictest60250irq/125-lan21:55:212
3197991717,0cyclictest60250irq/125-lan22:39:112
3197991717,0cyclictest60250irq/125-lan22:15:292
3197991717,0cyclictest60250irq/125-lan20:25:212
3197991716,1cyclictest60250irq/125-lan23:47:102
3197991716,1cyclictest60250irq/125-lan23:30:182
3197991716,1cyclictest60250irq/125-lan23:10:162
3197991716,1cyclictest60250irq/125-lan20:50:132
3197991716,1cyclictest60250irq/125-lan20:00:242
3197991716,1cyclictest60250irq/125-lan19:55:232
3197991716,1cyclictest60250irq/125-lan00:25:212
3197991715,1cyclictest60250irq/125-lan00:35:182
3197991616,0cyclictest60250irq/125-lan23:40:162
3197991616,0cyclictest60250irq/125-lan23:21:112
3197991616,0cyclictest60250irq/125-lan22:15:002
3197991616,0cyclictest60250irq/125-lan19:31:492
3197991615,1cyclictest60250irq/125-lan23:55:262
3197991615,1cyclictest60250irq/125-lan22:55:142
3197991615,1cyclictest60250irq/125-lan22:25:232
3197991615,1cyclictest60250irq/125-lan20:40:502
3197991615,1cyclictest60250irq/125-lan20:20:132
3197991615,1cyclictest60250irq/125-lan19:45:152
3197991615,1cyclictest60250irq/125-lan00:05:162
3197991615,1cyclictest60250irq/125-lan00:00:202
3197991515,0cyclictest60250irq/125-lan23:19:122
3197991515,0cyclictest60250irq/125-lan21:04:562
3197991515,0cyclictest60250irq/125-lan20:17:062
3197991515,0cyclictest60250irq/125-lan00:20:232
3197991514,1cyclictest60250irq/125-lan22:00:142
3197991514,1cyclictest60250irq/125-lan21:50:212
3197991514,1cyclictest60250irq/125-lan21:35:242
3197991514,1cyclictest60250irq/125-lan20:45:212
3197991514,1cyclictest60250irq/125-lan20:30:222
3197991514,1cyclictest60250irq/125-lan19:23:102
3197991514,1cyclictest60250irq/125-lan19:15:142
3197991414,0cyclictest60250irq/125-lan22:40:362
3197991414,0cyclictest60250irq/125-lan22:09:082
3197991414,0cyclictest60250irq/125-lan19:50:212
3197991414,0cyclictest60250irq/125-lan19:26:242
3197991413,1cyclictest60250irq/125-lan23:25:182
3197991413,1cyclictest60250irq/125-lan23:25:172
3197991413,1cyclictest60250irq/125-lan22:45:212
3197991413,1cyclictest60250irq/125-lan21:10:002
3197991413,1cyclictest60250irq/125-lan00:31:162
3186991414,0cyclictest329-21hwrng23:42:040
3186991414,0cyclictest329-21hwrng21:50:280
3197991313,0cyclictest60250irq/125-lan20:55:162
3197991312,1cyclictest60250irq/125-lan22:22:092
3197991312,1cyclictest60250irq/125-lan20:35:182
3197991312,1cyclictest60250irq/125-lan19:40:202
3197991312,1cyclictest60250irq/125-lan19:10:182
3193991313,0cyclictest329-21hwrng23:33:531
3186991313,0cyclictest329-21hwrng23:53:200
3197991212,0cyclictest60250irq/125-lan23:37:112
3197991212,0cyclictest60250irq/125-lan22:51:472
3197991212,0cyclictest60250irq/125-lan20:05:122
3197991211,1cyclictest60250irq/125-lan21:40:182
3197991211,1cyclictest60250irq/125-lan20:10:142
3193991212,0cyclictest329-21hwrng22:46:461
3197991111,0cyclictest60250irq/125-lan21:32:282
3197991111,0cyclictest60250irq/125-lan19:35:172
3197991110,1cyclictest60250irq/125-lan23:02:402
3197991110,1cyclictest60250irq/125-lan21:20:142
3193991111,0cyclictest329-21hwrng21:52:311
3186991111,0cyclictest329-21hwrng22:19:070
319799109,1cyclictest60250irq/125-lan21:05:222
3197991010,0cyclictest60250irq/125-lan21:25:152
3193991010,0cyclictest329-21hwrng22:18:071
318699108,2cyclictest702-21snmpd22:57:070
318699106,3cyclictest702-21snmpd21:14:510
3186991010,0cyclictest329-21hwrng21:40:120
3186991010,0cyclictest329-21hwrng21:07:270
318699100,6cyclictest0-21swapper/019:50:140
318699100,5cyclictest30969-21ld21:35:210
318699100,5cyclictest16483-21expr19:40:190
31979998,1cyclictest60250irq/125-lan21:47:412
31979998,1cyclictest60250irq/125-lan00:18:012
31979998,1cyclictest60250irq/125-lan00:18:002
31939999,0cyclictest329-21hwrng23:40:011
31939999,0cyclictest329-21hwrng20:39:471
31939998,1cyclictest702-21snmpd21:06:431
31939998,1cyclictest702-21snmpd19:10:111
31939993,3cyclictest2078-21perl20:25:161
31869997,2cyclictest702-21snmpd22:48:450
31869997,2cyclictest702-21snmpd22:08:210
31869997,2cyclictest702-21snmpd19:47:130
31869997,2cyclictest702-21snmpd00:27:520
31869996,3cyclictest702-21snmpd23:13:550
31869990,5cyclictest10689-21timerwakeupswit19:25:220
32029988,0cyclictest702-21snmpd21:13:423
32029988,0cyclictest702-21snmpd20:01:263
32029988,0cyclictest702-21snmpd19:18:173
32029988,0cyclictest329-21hwrng23:19:333
32029988,0cyclictest329-21hwrng22:55:593
32029988,0cyclictest329-21hwrng22:48:503
32029988,0cyclictest329-21hwrng22:31:253
32029988,0cyclictest329-21hwrng21:34:053
32029988,0cyclictest329-21hwrng21:29:583
32029988,0cyclictest329-21hwrng21:06:253
32029988,0cyclictest329-21hwrng19:26:053
32029988,0cyclictest329-21hwrng19:21:583
32029987,1cyclictest702-21snmpd22:44:423
32029987,1cyclictest702-21snmpd19:35:573
31979988,0cyclictest60250irq/125-lan22:30:142
31939988,0cyclictest702-21snmpd23:01:301
31939988,0cyclictest702-21snmpd20:30:181
31939988,0cyclictest329-21hwrng21:11:321
31939988,0cyclictest329-21hwrng20:21:211
31939988,0cyclictest329-21hwrng20:14:111
31939988,0cyclictest329-21hwrng20:03:581
31939988,0cyclictest329-21hwrng19:41:251
31939987,1cyclictest702-21snmpd19:27:511
31939986,2cyclictest702-21snmpd22:09:391
31939984,2cyclictest0-21swapper/123:39:111
31939982,4cyclictest10726-21ntpq20:45:181
31939982,2cyclictest25674-21tune2fs00:00:161
31869988,0cyclictest702-21snmpd00:01:510
31869987,1cyclictest702-21snmpd21:49:380
31869987,1cyclictest702-21snmpd20:04:470
31869987,1cyclictest702-21snmpd19:16:570
31869986,2cyclictest702-21snmpd20:59:300
31869986,2cyclictest702-21snmpd20:54:400
31869986,2cyclictest702-21snmpd20:17:230
31869986,1cyclictest329-21hwrng23:15:260
31869985,3cyclictest702-21snmpd00:12:560
31869980,4cyclictest9048-21wc20:40:210
31869980,4cyclictest707-21runrttasks00:36:180
31869980,4cyclictest5561-21chrt20:34:300
31869980,4cyclictest32259-21cat20:20:150
31869980,4cyclictest32192-21ntpq00:15:160
31869980,4cyclictest32192-21ntpq00:15:160
31869980,4cyclictest30460-21taskset22:51:300
31869980,4cyclictest29328-21cut00:10:010
31869980,4cyclictest24873-21ld21:20:180
31869980,4cyclictest24508-21chrt22:37:590
31869980,4cyclictest17741-21taskset21:04:430
32029977,0cyclictest702-21snmpd23:55:063
32029977,0cyclictest702-21snmpd20:57:543
32029977,0cyclictest702-21snmpd20:41:443
32029977,0cyclictest702-21snmpd20:35:443
32029977,0cyclictest702-21snmpd19:45:283
32029977,0cyclictest329-21hwrng23:47:123
32029977,0cyclictest329-21hwrng23:20:343
32029977,0cyclictest329-21hwrng23:13:233
32029977,0cyclictest329-21hwrng23:00:063
32029977,0cyclictest329-21hwrng22:50:533
32029977,0cyclictest329-21hwrng22:35:313
32029977,0cyclictest329-21hwrng22:27:183
32029977,0cyclictest329-21hwrng22:12:583
32029977,0cyclictest329-21hwrng22:05:483
32029977,0cyclictest329-21hwrng22:02:453
32029977,0cyclictest329-21hwrng21:54:323
32029977,0cyclictest329-21hwrng21:46:223
32029977,0cyclictest329-21hwrng21:35:053
32029977,0cyclictest329-21hwrng21:24:513
32029977,0cyclictest329-21hwrng21:04:233
32029977,0cyclictest329-21hwrng19:12:463
32029976,1cyclictest702-21snmpd23:42:083
32029976,1cyclictest702-21snmpd23:31:443
32029976,1cyclictest702-21snmpd19:41:373
32029976,1cyclictest702-21snmpd00:30:183
32029976,1cyclictest32636-21cat21:40:153
32029975,1cyclictest702-21snmpd00:00:273
31979977,0cyclictest329-21hwrng23:54:212
31939977,0cyclictest702-21snmpd23:07:161
31939977,0cyclictest702-21snmpd19:57:251
31939976,1cyclictest680-21ntpd23:56:591
31939975,2cyclictest702-21snmpd00:36:211
31939973,3cyclictest6506-21latency_hist23:15:001
31939973,3cyclictest13751-21/usr/sbin/munin19:35:131
31939972,3cyclictest31604-21taskset21:36:171
31939972,3cyclictest22586-21seq22:34:091
31939972,3cyclictest1729-21sed00:20:201
31939972,3cyclictest13066-21chrt19:32:031
31939972,2cyclictest8794-21taskset23:20:111
31939972,2cyclictest28754-21sed21:30:141
31939972,2cyclictest12063-21cpuspeed_turbos22:10:111
31939972,2cyclictest10992-21base6423:25:001
31939972,2cyclictest10992-21base6423:25:001
31939972,1cyclictest27601-21df_inode00:05:121
31939971,4cyclictest30936-21seq00:11:521
31939971,4cyclictest27178-21runrttasks20:06:551
31939971,3cyclictest707-21runrttasks20:42:021
31939971,2cyclictest18398-21sed19:45:171
31939970,3cyclictest20062-21cat19:50:141
31869977,0cyclictest702-21snmpd23:01:120
31869977,0cyclictest702-21snmpd21:33:490
31869974,3cyclictest702-21snmpd23:31:050
31869974,3cyclictest702-21snmpd22:26:360
31869971,3cyclictest707-21runrttasks19:31:090
31869970,6cyclictest14042-21irqstats19:35:150
31869970,5cyclictest0-21swapper/023:21:060
31869970,4cyclictest8937-21wc22:00:180
31869970,4cyclictest707-21runrttasks20:07:470
31869970,4cyclictest6161-21perl21:55:130
31869970,4cyclictest22382-21ntpq19:55:180
31869970,4cyclictest16862-21sshd23:37:550
31869970,4cyclictest0-21swapper/023:55:170
31869970,3cyclictest6713-21ntpq20:35:190
31869970,3cyclictest22520-21chrt22:33:170
31869970,3cyclictest18292-21taskset22:20:480
32029966,0cyclictest702-21snmpd23:26:113
32029966,0cyclictest702-21snmpd23:26:103
32029966,0cyclictest702-21snmpd20:49:253
32029966,0cyclictest329-21hwrng23:05:133
32029966,0cyclictest329-21hwrng19:34:153
32029966,0cyclictest329-21hwrng00:36:213
32029965,1cyclictest702-21snmpd20:54:273
32029965,1cyclictest396-21needreboot20:20:173
31939965,1cyclictest8167-21needreboot19:20:151
31939965,1cyclictest702-21snmpd22:02:121
31939965,1cyclictest702-21snmpd21:46:591
31939965,1cyclictest17334-21cat22:20:151
31939963,2cyclictest6188-21fw_conntrack21:55:141
31939963,2cyclictest3704-21memory00:25:161
31939963,2cyclictest23234-21fw_packets22:35:161
31939963,2cyclictest19749-21ntpq22:25:181
31939962,3cyclictest21899-21memory23:50:141
31939962,3cyclictest16798-21ld21:00:181
31939962,3cyclictest14173-21df_inode20:55:131
31939962,1cyclictest26841-21ntp_192.168.11421:25:171
31939962,1cyclictest24823-21ntpq21:20:171
31939962,1cyclictest22798-21ntpq21:15:181
31939962,1cyclictest0-21swapper/122:55:211
31939961,4cyclictest612-21runrttasks00:17:451
31939961,4cyclictest612-21runrttasks00:17:451
31939961,2cyclictest6467-21seq19:15:211
31939961,2cyclictest12395-21/usr/sbin/munin20:50:151
31939961,2cyclictest0-21swapper/120:15:231
31869960,5cyclictest9957-21/usr/sbin/munin20:45:130
31869960,5cyclictest8285-21ntpq19:20:170
31869960,5cyclictest3029-21expr23:05:130
31869960,5cyclictest27799-21grep20:10:130
31869960,5cyclictest2580-21ntpq20:25:190
31869960,5cyclictest22364-21/usr/sbin/munin21:15:140
31869960,5cyclictest1939-21ldconfig00:20:210
31869960,5cyclictest12324-21expr22:10:130
31869960,5cyclictest11411-21/usr/sbin/munin23:25:140
31869960,5cyclictest11411-21/usr/sbin/munin23:25:130
31869960,3cyclictest3968-21memory19:10:170
31869960,3cyclictest0-21swapper/023:48:440
32029955,0cyclictest702-21snmpd00:16:573
32029955,0cyclictest702-21snmpd00:16:563
32029953,2cyclictest702-21snmpd23:51:043
31939953,2cyclictest6744-21apt-get23:15:111
31939953,2cyclictest29271-21perl22:50:151
31939953,2cyclictest19499-21diskstats23:45:141
31939952,2cyclictest24937-21sshd22:40:081
31939952,2cyclictest0-21swapper/100:30:131
31939951,1cyclictest32366-21df_inode21:40:131
31869951,4cyclictest5380-21grep00:30:140
31869950,5cyclictest27047-21ls21:25:190
31869950,5cyclictest25260-21fw_conntrack22:40:140
32029944,0cyclictest329-21hwrng19:59:523
32029943,1cyclictest702-21snmpd20:19:413
32029943,1cyclictest702-21snmpd00:06:083
32029943,1cyclictest361-21kworker/3:0+events_freezable_power_20:34:153
32029943,1cyclictest361-21kworker/3:0+events_freezable_power_19:50:183
32029943,1cyclictest361-21kworker/3:0+events_freezable_power_00:24:533
32029943,1cyclictest22436-21grep21:15:153
32029942,2cyclictest702-21snmpd20:09:373
32029933,0cyclictest702-21snmpd22:23:163
32029932,1cyclictest702-21snmpd00:10:513
32029932,1cyclictest3893-21ntpq00:25:173
32029932,1cyclictest15061-21needreboot22:15:163
32029932,1cyclictest0-21swapper/323:35:103
32029932,1cyclictest0-21swapper/320:25:203
32029930,3cyclictest6752-21ntpq21:55:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional