You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-16 - 21:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot7.osadl.org (updated Thu Oct 16, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2111992019,1cyclictest60250irq/125-lan11:05:222
2111991918,1cyclictest60250irq/125-lan09:55:132
2111991916,1cyclictest60250irq/125-lan08:35:012
2111991915,1cyclictest60250irq/125-lan10:05:142
2111991817,1cyclictest60250irq/125-lan12:20:032
2111991817,1cyclictest60250irq/125-lan11:32:002
2111991817,1cyclictest60250irq/125-lan09:05:232
2111991816,2cyclictest60250irq/125-lan11:20:222
2111991816,2cyclictest60250irq/125-lan11:20:222
2111991816,2cyclictest60250irq/125-lan09:10:132
2111991816,1cyclictest60250irq/125-lan11:53:292
2111991815,1cyclictest60250irq/125-lan10:40:192
2111991717,0cyclictest60250irq/125-lan12:05:232
2111991717,0cyclictest60250irq/125-lan11:38:042
2111991716,1cyclictest60250irq/125-lan10:45:162
2111991716,1cyclictest60250irq/125-lan10:10:132
2111991716,1cyclictest60250irq/125-lan09:45:002
2111991716,1cyclictest60250irq/125-lan08:53:122
2111991716,1cyclictest60250irq/125-lan08:40:102
2111991716,1cyclictest60250irq/125-lan08:20:152
2111991716,1cyclictest60250irq/125-lan08:00:192
2111991716,1cyclictest60250irq/125-lan07:45:192
2111991716,1cyclictest60250irq/125-lan07:30:012
2111991715,1cyclictest60250irq/125-lan10:50:202
2111991715,1cyclictest60250irq/125-lan10:02:102
2111991616,0cyclictest60250irq/125-lan12:12:322
2111991616,0cyclictest60250irq/125-lan10:25:432
2111991616,0cyclictest60250irq/125-lan09:29:382
2111991616,0cyclictest60250irq/125-lan07:35:072
2111991616,0cyclictest60250irq/125-lan07:10:122
2111991615,1cyclictest60250irq/125-lan10:30:012
2111991615,1cyclictest60250irq/125-lan08:15:162
2111991615,1cyclictest60250irq/125-lan07:20:152
2111991514,1cyclictest60250irq/125-lan12:00:152
2111991514,1cyclictest60250irq/125-lan11:45:142
2111991514,1cyclictest60250irq/125-lan11:15:152
2111991514,1cyclictest60250irq/125-lan09:20:552
2111991514,1cyclictest60250irq/125-lan08:35:162
2111991514,1cyclictest60250irq/125-lan07:40:132
2106991515,0cyclictest702-21snmpd12:11:181
2106991515,0cyclictest329-21hwrng12:32:011
2106991515,0cyclictest329-21hwrng11:45:561
2106991515,0cyclictest329-21hwrng11:41:501
2106991515,0cyclictest329-21hwrng11:11:071
2111991414,0cyclictest60250irq/125-lan11:41:152
2111991414,0cyclictest60250irq/125-lan09:35:132
2111991414,0cyclictest60250irq/125-lan09:00:132
2111991413,1cyclictest60250irq/125-lan11:01:172
2111991413,1cyclictest60250irq/125-lan10:20:162
2111991413,1cyclictest60250irq/125-lan09:15:122
2111991413,1cyclictest60250irq/125-lan08:15:012
2111991413,1cyclictest60250irq/125-lan08:05:152
2111991413,1cyclictest60250irq/125-lan07:50:192
2106991414,0cyclictest702-21snmpd11:52:351
2106991414,0cyclictest702-21snmpd08:59:051
2106991414,0cyclictest702-21snmpd08:59:051
2106991414,0cyclictest702-21snmpd08:26:101
2106991414,0cyclictest329-21hwrng11:16:141
2106991414,0cyclictest329-21hwrng10:00:281
2106991414,0cyclictest329-21hwrng09:52:161
2106991414,0cyclictest32048-21cat10:55:131
2106991414,0cyclictest22302-21cat07:55:121
2111991313,0cyclictest60250irq/125-lan09:33:112
2111991313,0cyclictest60250irq/125-lan07:30:182
2111991312,1cyclictest60250irq/125-lan12:35:142
2111991312,1cyclictest60250irq/125-lan12:16:242
2111991312,1cyclictest60250irq/125-lan09:50:132
2111991312,1cyclictest60250irq/125-lan07:55:202
2111991212,0cyclictest60250irq/125-lan07:15:132
2111991211,1cyclictest60250irq/125-lan11:55:202
2111991211,1cyclictest60250irq/125-lan08:55:172
2111991211,1cyclictest60250irq/125-lan08:55:172
2106991212,0cyclictest329-21hwrng11:03:571
2106991212,0cyclictest329-21hwrng08:24:111
2106991212,0cyclictest329-21hwrng08:19:051
2111991111,0cyclictest60250irq/125-lan12:32:322
2111991111,0cyclictest60250irq/125-lan09:40:192
2111991111,0cyclictest60250irq/125-lan08:45:282
2111991110,1cyclictest60250irq/125-lan12:27:462
2106991111,0cyclictest329-21hwrng09:09:161
2106991111,0cyclictest329-21hwrng07:48:221
2102991111,0cyclictest329-21hwrng09:08:140
2111991010,0cyclictest60250irq/125-lan10:17:292
2111991010,0cyclictest60250irq/125-lan08:26:292
2106991010,0cyclictest329-21hwrng11:55:091
2106991010,0cyclictest329-21hwrng11:37:441
2106991010,0cyclictest329-21hwrng10:16:511
2106991010,0cyclictest329-21hwrng10:14:481
2106991010,0cyclictest329-21hwrng09:15:241
2106991010,0cyclictest329-21hwrng07:31:591
2106991010,0cyclictest329-21hwrng07:26:521
21189998,1cyclictest702-21snmpd08:22:253
21119998,1cyclictest60250irq/125-lan11:25:222
21119998,1cyclictest60250irq/125-lan11:10:272
21069999,0cyclictest329-21hwrng11:06:001
21069999,0cyclictest329-21hwrng10:43:281
21069999,0cyclictest329-21hwrng10:05:351
21069999,0cyclictest329-21hwrng09:49:121
21069999,0cyclictest329-21hwrng09:39:591
21069999,0cyclictest329-21hwrng08:46:441
21069999,0cyclictest329-21hwrng07:51:251
21069998,1cyclictest702-21snmpd12:35:271
21189988,0cyclictest702-21snmpd11:21:553
21189988,0cyclictest702-21snmpd11:21:553
21189987,1cyclictest702-21snmpd07:56:003
21119987,1cyclictest60250irq/125-lan10:55:142
21069988,0cyclictest702-21snmpd12:16:181
21069988,0cyclictest702-21snmpd09:13:571
21069988,0cyclictest702-21snmpd07:12:191
21069988,0cyclictest329-21hwrng11:33:381
21069988,0cyclictest329-21hwrng10:45:311
21069988,0cyclictest329-21hwrng09:41:001
21069988,0cyclictest329-21hwrng09:32:491
21069988,0cyclictest329-21hwrng09:26:401
21069986,2cyclictest702-21snmpd08:06:441
21029988,0cyclictest702-21snmpd09:37:040
21029988,0cyclictest702-21snmpd09:20:000
21029987,1cyclictest702-21snmpd12:21:450
21029987,1cyclictest702-21snmpd10:41:570
21189977,0cyclictest702-21snmpd12:14:243
21189977,0cyclictest702-21snmpd12:03:563
21189977,0cyclictest702-21snmpd11:59:233
21189977,0cyclictest702-21snmpd11:37:353
21189977,0cyclictest702-21snmpd10:15:253
21189977,0cyclictest702-21snmpd10:09:053
21189977,0cyclictest702-21snmpd08:33:553
21189977,0cyclictest329-21hwrng12:07:263
21189976,1cyclictest702-21snmpd12:22:513
21189976,1cyclictest702-21snmpd11:54:323
21189976,1cyclictest702-21snmpd11:11:043
21189976,1cyclictest702-21snmpd10:35:473
21189976,1cyclictest702-21snmpd09:04:013
21189976,1cyclictest702-21snmpd08:42:383
21189976,1cyclictest3632-21gltestperf11:05:143
21189975,2cyclictest702-21snmpd07:31:403
21069977,0cyclictest702-21snmpd07:38:101
21069977,0cyclictest329-21hwrng12:29:581
21069977,0cyclictest329-21hwrng08:43:401
21069976,1cyclictest702-21snmpd12:22:241
21069976,1cyclictest702-21snmpd10:31:051
21069976,1cyclictest702-21snmpd09:59:041
21069976,1cyclictest702-21snmpd08:54:101
21069976,1cyclictest702-21snmpd07:43:261
21029977,0cyclictest702-21snmpd11:55:560
21029977,0cyclictest702-21snmpd08:11:180
21029977,0cyclictest702-21snmpd07:38:310
21029977,0cyclictest329-21hwrng11:10:050
21029976,1cyclictest702-21snmpd10:20:580
21029976,1cyclictest13969-21turbostat08:55:010
21029976,1cyclictest11140-21munin-plugin-st11:25:000
21029976,1cyclictest11140-21munin-plugin-st11:24:590
21029974,1cyclictest17176-21turbostat07:45:010
21189966,0cyclictest702-21snmpd10:55:393
21189966,0cyclictest702-21snmpd09:36:003
21189966,0cyclictest702-21snmpd09:34:503
21189966,0cyclictest702-21snmpd08:27:463
21189966,0cyclictest702-21snmpd08:03:033
21189965,1cyclictest702-21snmpd10:20:323
21189965,1cyclictest702-21snmpd09:57:523
21189965,1cyclictest702-21snmpd09:28:573
21189965,1cyclictest702-21snmpd08:48:563
21189965,1cyclictest702-21snmpd07:29:323
21119965,1cyclictest60250irq/125-lan10:35:132
21069966,0cyclictest702-21snmpd12:00:501
21069966,0cyclictest702-21snmpd11:27:041
21069966,0cyclictest702-21snmpd10:37:051
21069966,0cyclictest702-21snmpd08:04:541
21069965,1cyclictest702-21snmpd09:00:311
21029966,0cyclictest702-21snmpd09:03:110
21029966,0cyclictest702-21snmpd07:51:500
21029966,0cyclictest19175-21latency_hist07:50:010
21029965,1cyclictest702-21snmpd10:30:350
21029965,1cyclictest702-21snmpd09:46:370
21029965,1cyclictest702-21snmpd09:30:480
21189955,0cyclictest702-21snmpd11:32:463
21189955,0cyclictest702-21snmpd10:53:423
21189955,0cyclictest702-21snmpd10:40:183
21189955,0cyclictest702-21snmpd07:54:513
21189954,1cyclictest702-21snmpd11:48:413
21189954,1cyclictest702-21snmpd09:09:483
21189953,2cyclictest702-21snmpd10:00:183
21189953,2cyclictest702-21snmpd07:21:563
21069954,1cyclictest702-21snmpd09:22:241
21069953,2cyclictest702-21snmpd07:20:371
21029955,0cyclictest702-21snmpd10:12:470
21029955,0cyclictest702-21snmpd08:46:140
21029955,0cyclictest329-21hwrng09:24:370
21029954,1cyclictest702-21snmpd10:56:090
21029954,1cyclictest702-21snmpd08:18:130
21029954,1cyclictest702-21snmpd07:16:520
21029954,1cyclictest29046-21needreboot12:05:160
21029954,1cyclictest16983-21needreboot11:35:200
21029954,1cyclictest10321-21idleruntime-cro10:05:000
21029953,2cyclictest14588-21ntpq11:30:150
21189944,0cyclictest828-21gltestperf12:15:153
21189944,0cyclictest702-21snmpd08:17:163
21189944,0cyclictest702-21snmpd07:10:433
21189944,0cyclictest329-21hwrng11:25:273
21189944,0cyclictest329-21hwrng10:26:043
21189944,0cyclictest329-21hwrng08:55:573
21189944,0cyclictest329-21hwrng08:55:573
21189944,0cyclictest329-21hwrng08:35:283
21189944,0cyclictest329-21hwrng08:11:553
21189944,0cyclictest329-21hwrng07:40:103
21189944,0cyclictest329-21hwrng07:35:033
21189944,0cyclictest329-21hwrng07:18:393
21189943,1cyclictest702-21snmpd11:00:123
21189943,1cyclictest702-21snmpd09:17:533
21189943,1cyclictest702-21snmpd07:45:023
21189943,1cyclictest2097-21cyclictest08:53:323
21189942,2cyclictest21606-21uptime09:10:213
21069943,1cyclictest4135-21cpuspeed_turbos08:30:121
21069943,1cyclictest10244-21ntpq11:20:191
21069943,1cyclictest10244-21ntpq11:20:191
21069942,2cyclictest29773-21diskstats10:50:131
21069942,2cyclictest29606-21sed12:05:221
21069940,1cyclictest0-21swapper/110:25:181
21029944,0cyclictest702-21snmpd11:45:520
21029944,0cyclictest329-21hwrng12:36:060
21029944,0cyclictest329-21hwrng12:26:530
21029944,0cyclictest329-21hwrng12:15:360
21029944,0cyclictest329-21hwrng12:10:300
21029944,0cyclictest329-21hwrng11:41:500
21029944,0cyclictest329-21hwrng10:25:020
21029944,0cyclictest329-21hwrng09:44:050
21029944,0cyclictest329-21hwrng09:10:170
21029944,0cyclictest329-21hwrng08:41:370
21029944,0cyclictest329-21hwrng08:31:220
21029944,0cyclictest329-21hwrng08:29:190
21029944,0cyclictest329-21hwrng08:05:450
21029944,0cyclictest329-21hwrng07:11:300
21029943,1cyclictest7249-21ntpq09:55:160
21029943,1cyclictest702-21snmpd11:16:100
21029943,1cyclictest702-21snmpd10:18:110
21029943,1cyclictest702-21snmpd08:58:260
21029943,1cyclictest702-21snmpd08:58:260
21029943,1cyclictest5186-21ntp_192.168.11409:50:160
21029943,1cyclictest405-21cat08:20:170
21029943,1cyclictest2998-21sh11:05:000
21029943,1cyclictest11771-21gltestperf11:25:140
21029942,2cyclictest702-21snmpd07:21:160
21029942,2cyclictest4075-21ntpq11:05:160
21029942,2cyclictest11308-21cat07:30:120
21189933,0cyclictest702-21snmpd08:05:213
21189933,0cyclictest329-21hwrng11:15:133
21189933,0cyclictest329-21hwrng10:31:103
21189933,0cyclictest0-21swapper/309:50:153
21189932,1cyclictest702-21snmpd10:45:213
21189932,1cyclictest4649-21grep12:25:113
21189932,1cyclictest2852-21ntpq09:45:173
21189932,1cyclictest18627-21fw_conntrack11:40:133
21189932,1cyclictest0-21swapper/312:30:133
21189931,2cyclictest8903-21gltestperf12:35:113
21189931,2cyclictest765-21ntpq09:40:173
21189931,2cyclictest702-21snmpd10:14:473
21189930,3cyclictest24284-21/usr/sbin/munin09:20:133
21069931,2cyclictest4540-21expr07:15:131
21069931,0cyclictest171rcu_preempt08:35:131
21069930,2cyclictest17256-21diskstats10:20:131
21029933,0cyclictest329-21hwrng11:50:020
21029933,0cyclictest329-21hwrng10:06:360
21029932,1cyclictest9176-21gcc07:25:170
21029931,2cyclictest7732-21cat12:30:190
21029931,2cyclictest27047-21ntpq09:25:130
21029931,2cyclictest24340-21cat08:00:170
21029931,2cyclictest22539-21cut07:55:130
21029930,3cyclictest27596-21apt-get10:45:120
21029930,3cyclictest27180-21ntpq12:00:130
21069920,2cyclictest27940-21apt-get08:10:121
21029921,1cyclictest702-21snmpd08:35:030
21029920,2cyclictest29581-21/usr/sbin/munin10:50:110
21029920,2cyclictest23713-21/usr/sbin/munin10:35:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional