You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 18:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Mon Mar 23, 2026 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
233872236221,10sleep10-21swapper/107:06:111
235872197180,12sleep00-21swapper/007:08:460
236622187170,12sleep30-21swapper/307:09:463
234702184167,12sleep20-21swapper/207:07:162
138642430,0sleep20-21swapper/210:09:562
57962120,0sleep35798-21sh10:05:193
234452100,0sleep30-21swapper/312:05:133
238589991,4cyclictest8824-21basename10:55:010
16300290,0sleep30-21swapper/307:55:163
238589960,6cyclictest0-21swapper/011:22:180
238589960,5cyclictest0-21swapper/012:15:120
238589960,5cyclictest0-21swapper/008:50:120
31993250,0sleep10-21swapper/111:37:381
31566250,0sleep10-21swapper/109:46:211
238679953,1cyclictest9057-21ssh10:55:013
238679950,5cyclictest27152-21sh12:39:313
238679950,5cyclictest17316-21apt-get09:40:013
238679950,5cyclictest0-21swapper/312:24:143
238679950,5cyclictest0-21swapper/312:12:093
238679950,5cyclictest0-21swapper/309:22:133
238679950,0cyclictest2907-21ssh11:07:243
238679950,0cyclictest0-21swapper/310:01:553
238619955,0cyclictest0-21swapper/211:27:382
238619955,0cyclictest0-21swapper/211:17:522
238619955,0cyclictest0-21swapper/210:51:422
238619954,1cyclictest31-21ksoftirqd/207:50:012
238619953,1cyclictest21886-21diskstats10:45:112
238619950,5cyclictest4022-21ssh09:17:332
238619950,5cyclictest0-21swapper/211:12:382
238619950,5cyclictest0-21swapper/207:24:292
238619950,4cyclictest0-21swapper/209:36:582
238619950,0cyclictest0-21swapper/211:07:242
238599950,5cyclictest0-21swapper/111:23:371
238599950,5cyclictest0-21swapper/111:19:071
238599950,5cyclictest0-21swapper/110:32:421
238599950,3cyclictest0-21swapper/108:40:121
238599950,0cyclictest0-21swapper/112:37:161
238589955,0cyclictest19873-21diskmemload12:13:400
238589950,5cyclictest0-21swapper/011:39:360
238589950,5cyclictest0-21swapper/010:47:060
238589950,5cyclictest0-21swapper/009:25:460
238589950,5cyclictest0-21swapper/008:15:020
238589950,5cyclictest0-21swapper/008:15:010
238589950,4cyclictest0-21swapper/010:30:100
238589950,1cyclictest32160-21awk07:25:000
238589950,1cyclictest26223-21munin-run07:15:000
238589950,0cyclictest0-21swapper/011:08:020
238679944,0cyclictest7879-21ssh09:19:523
238679944,0cyclictest26441-21kworker/3:108:59:363
238679944,0cyclictest26441-21kworker/3:108:26:013
238679944,0cyclictest26441-21kworker/3:107:52:243
238679944,0cyclictest26441-21kworker/3:107:41:163
238679944,0cyclictest0-21swapper/311:42:283
238679943,1cyclictest7083-21/usr/sbin/munin09:35:163
238679943,1cyclictest6120-21cut11:25:133
238679943,1cyclictest25513-21tr08:15:113
238679943,1cyclictest25513-21tr08:15:113
238679943,1cyclictest2420-21/usr/sbin/munin07:30:153
238679943,1cyclictest23574-21tail08:10:133
238679942,2cyclictest0-21swapper/309:45:183
238679942,1cyclictest24362-21ssh09:27:223
238679941,2cyclictest0-21swapper/308:45:113
238679940,4cyclictest8218-21apt-get12:30:103
238679940,4cyclictest30247-21apt-get12:25:003
238679940,4cyclictest27795-21apt-get08:20:123
238679940,3cyclictest809-21runrttasks07:35:013
238679940,3cyclictest7962-21sh10:22:223
238679940,3cyclictest26433-21munin-node07:15:003
238679940,3cyclictest26013-21chrt11:35:033
238679940,3cyclictest21769-21latency_hist12:04:593
238679940,3cyclictest20335-21sshd08:05:023
238679940,3cyclictest14891-21perl11:45:153
238679940,3cyclictest10242-21perl10:55:143
238679940,1cyclictest5264-21/usr/sbin/munin08:40:153
238679940,1cyclictest32729-21/usr/sbin/munin08:30:143
238679940,1cyclictest25507-21perl10:15:153
238679940,1cyclictest15122-21diskstats10:10:133
238679940,0cyclictest57250irq/130-eth009:12:103
238679940,0cyclictest0-21swapper/309:58:093
238619944,0cyclictest0-21swapper/212:05:182
238619944,0cyclictest0-21swapper/210:30:102
238619944,0cyclictest0-21swapper/209:12:102
238619944,0cyclictest0-21swapper/208:55:332
238619943,1cyclictest636-21ssh10:35:042
238619943,1cyclictest5457-21cut07:35:142
238619943,1cyclictest5277-21ssh11:56:052
238619943,1cyclictest4110-21sed10:20:192
238619943,1cyclictest31-21ksoftirqd/211:00:112
238619943,1cyclictest13198-21ssh09:21:502
238619943,1cyclictest11623-21ssh10:55:222
238619943,1cyclictest0-21swapper/207:58:572
238619942,1cyclictest5774-21ssh09:34:322
238619942,1cyclictest32430-21ssh12:10:102
238619942,1cyclictest24677-21ssh10:15:072
238619941,2cyclictest1192-21ntpq07:25:182
238619940,4cyclictest30497-21apt-get12:25:112
238619940,4cyclictest15170-21apt-get09:00:122
238619940,4cyclictest1396-21ssh10:03:332
238619940,4cyclictest11378-21grep10:40:112
238619940,4cyclictest0-21swapper/212:35:162
238619940,4cyclictest0-21swapper/212:32:582
238619940,4cyclictest0-21swapper/212:20:242
238619940,4cyclictest0-21swapper/212:00:122
238619940,4cyclictest0-21swapper/211:45:122
238619940,4cyclictest0-21swapper/211:41:002
238619940,4cyclictest0-21swapper/211:31:522
238619940,4cyclictest0-21swapper/208:50:452
238619940,4cyclictest0-21swapper/207:30:112
238619940,3cyclictest9016-21ntp_states08:45:172
238619940,3cyclictest822-21df_inode08:30:122
238619940,3cyclictest6386-21/usr/sbin/munin09:50:142
238619940,3cyclictest32151-21rm11:21:342
238619940,3cyclictest27999-21expr08:20:112
238619940,3cyclictest27583-21ssh09:45:012
238619940,3cyclictest26056-21ssh11:35:062
238619940,3cyclictest25542-21ssh11:50:192
238619940,3cyclictest21206-21chrt09:41:162
238619940,3cyclictest18962-21ntp_states08:00:192
238619940,3cyclictest17984-21/usr/sbin/munin09:55:192
238619940,3cyclictest15797-21ssh12:17:352
238619940,3cyclictest12813-21/usr/sbin/munin10:25:132
238619940,1cyclictest20398-21open_files09:25:192
238619940,0cyclictest0-21swapper/210:10:042
238619940,0cyclictest0-21swapper/207:18:312
238599944,0cyclictest0-21swapper/109:25:201
238599942,1cyclictest0-21swapper/110:15:131
238599941,2cyclictest0-21swapper/111:50:131
238599941,2cyclictest0-21swapper/111:30:101
238599941,2cyclictest0-21swapper/110:45:091
238599941,2cyclictest0-21swapper/110:40:121
238599941,2cyclictest0-21swapper/109:30:111
238599941,2cyclictest0-21swapper/109:10:121
238599941,2cyclictest0-21swapper/108:50:121
238599941,2cyclictest0-21swapper/108:00:131
238599941,2cyclictest0-21swapper/107:40:111
238599941,1cyclictest0-21swapper/112:30:111
238599940,4cyclictest0-21swapper/110:39:241
238599940,2cyclictest0-21swapper/112:25:111
238599940,2cyclictest0-21swapper/111:10:121
238599940,0cyclictest0-21swapper/110:55:501
238599940,0cyclictest0-21swapper/109:55:101
238589944,0cyclictest0-21swapper/010:26:160
238589944,0cyclictest0-21swapper/009:35:030
238589942,1cyclictest19929-21awk08:05:010
238589941,2cyclictest2556-21munin-run08:35:000
238589940,4cyclictest8743-21ssh10:06:460
238589940,4cyclictest19027-21sh10:11:480
238589940,4cyclictest0-21swapper/012:35:120
238589940,4cyclictest0-21swapper/012:25:100
238589940,4cyclictest0-21swapper/012:05:100
238589940,4cyclictest0-21swapper/012:00:050
238589940,4cyclictest0-21swapper/011:51:330
238589940,4cyclictest0-21swapper/011:30:090
238589940,4cyclictest0-21swapper/011:25:110
238589940,4cyclictest0-21swapper/011:16:180
238589940,4cyclictest0-21swapper/010:20:130
238589940,4cyclictest0-21swapper/010:15:120
238589940,4cyclictest0-21swapper/010:00:170
238589940,4cyclictest0-21swapper/009:55:110
238589940,4cyclictest0-21swapper/009:50:160
238589940,4cyclictest0-21swapper/009:33:000
238589940,4cyclictest0-21swapper/009:20:120
238589940,4cyclictest0-21swapper/009:15:140
238589940,3cyclictest77262chrt08:45:020
238589940,3cyclictest5612-21df07:35:150
238589940,3cyclictest428-21df07:25:140
238589940,3cyclictest32001-21sh09:46:370
238589940,3cyclictest3173-21memory11:55:140
238589940,3cyclictest30177-21sort08:25:010
238589940,3cyclictest27208-21/usr/sbin/munin07:15:110
238589940,3cyclictest20948-21cat11:00:150
238589940,3cyclictest20352-21/usr/sbin/munin08:05:150
238589940,3cyclictest20002-21ssh12:20:020
238589940,3cyclictest17247-21ssh09:40:010
238589940,3cyclictest16248-21users11:45:220
238589940,3cyclictest16212-21sh10:58:100
238589940,3cyclictest15629-21sh10:41:490
238589940,3cyclictest13200-21df08:55:140
238589940,3cyclictest12581-21apt-config07:50:000
238589940,3cyclictest0-21swapper/007:30:120
238679933,0cyclictest40-21ksoftirqd/309:05:013
238679932,1cyclictest57250irq/130-eth010:25:033
238679932,1cyclictest18273-21fschecks_time09:05:153
238679931,2cyclictest57250irq/130-eth011:10:053
238679931,2cyclictest15893-21ssh11:30:043
238679931,1cyclictest10866-21sh10:40:023
238679931,1cyclictest0-21swapper/310:35:143
238679931,1cyclictest0-21swapper/308:50:123
238679931,1cyclictest0-21swapper/307:45:113
238679930,3cyclictest24106-21ssh11:50:053
238679930,3cyclictest18066-21tr11:15:123
238679930,3cyclictest1757-21ssh11:55:023
238679930,3cyclictest1456-21cut07:25:203
238679930,3cyclictest0-21swapper/312:15:123
238679930,3cyclictest0-21swapper/311:20:123
238679930,3cyclictest0-21swapper/311:00:103
238679930,3cyclictest0-21swapper/309:50:133
238679930,3cyclictest0-21swapper/308:35:113
238679930,3cyclictest0-21swapper/308:00:123
238679930,3cyclictest0-21swapper/307:20:103
238679930,3cyclictest0-21swapper/307:10:203
238679930,2cyclictest0-21swapper/310:45:033
238679930,1cyclictest29188-21ssh09:30:103
238679930,1cyclictest22934-21ssh10:30:073
238619930,3cyclictest20274-21apt-config08:05:002
238619930,3cyclictest0-21swapper/209:05:172
238619930,3cyclictest0-21swapper/208:40:112
238619930,3cyclictest0-21swapper/208:35:132
238619930,3cyclictest0-21swapper/208:25:112
238619930,3cyclictest0-21swapper/208:15:012
238619930,3cyclictest0-21swapper/208:15:002
238619930,3cyclictest0-21swapper/208:10:102
238619930,3cyclictest0-21swapper/207:50:022
238619930,3cyclictest0-21swapper/207:40:072
238619930,2cyclictest0-21swapper/207:10:112
238599933,0cyclictest0-21swapper/111:05:361
238599932,1cyclictest0-21swapper/111:00:111
238599931,2cyclictest0-21swapper/111:25:111
238599931,2cyclictest0-21swapper/110:00:121
238599931,2cyclictest0-21swapper/108:20:121
238599931,1cyclictest0-21swapper/112:20:091
238599931,1cyclictest0-21swapper/112:15:111
238599931,1cyclictest0-21swapper/112:10:101
238599931,1cyclictest0-21swapper/112:05:101
238599931,1cyclictest0-21swapper/112:00:121
238599931,1cyclictest0-21swapper/111:55:091
238599931,1cyclictest0-21swapper/111:40:121
238599931,1cyclictest0-21swapper/110:05:151
238599931,1cyclictest0-21swapper/109:50:121
238599931,1cyclictest0-21swapper/109:20:121
238599931,1cyclictest0-21swapper/109:05:131
238599931,1cyclictest0-21swapper/108:55:111
238599931,1cyclictest0-21swapper/108:35:121
238599931,1cyclictest0-21swapper/108:05:121
238599931,1cyclictest0-21swapper/107:55:121
238599931,1cyclictest0-21swapper/107:50:021
238599931,1cyclictest0-21swapper/107:30:131
238599931,1cyclictest0-21swapper/107:25:131
238599931,1cyclictest0-21swapper/107:20:021
238599931,1cyclictest0-21swapper/107:10:101
238599930,3cyclictest0-21swapper/108:34:061
238599930,3cyclictest0-21swapper/108:15:031
238599930,3cyclictest0-21swapper/108:15:031
238599930,2cyclictest0-21swapper/111:45:121
238599930,2cyclictest0-21swapper/110:50:111
238599930,2cyclictest0-21swapper/109:40:121
238599930,2cyclictest0-21swapper/108:59:591
238599930,2cyclictest0-21swapper/108:45:121
238599930,2cyclictest0-21swapper/107:35:011
238589932,1cyclictest814-21snmpd07:40:090
238589931,1cyclictest0-21swapper/011:40:120
238589931,1cyclictest0-21swapper/009:05:120
238589930,3cyclictest610-21sh10:35:020
238589930,3cyclictest10584-21diskstats07:45:130
238589930,3cyclictest0-21swapper/012:30:020
238589930,3cyclictest0-21swapper/011:10:020
238589930,3cyclictest0-21swapper/009:10:110
238589930,3cyclictest0-21swapper/009:00:110
238589930,3cyclictest0-21swapper/008:40:110
238589930,3cyclictest0-21swapper/008:35:000
238589930,3cyclictest0-21swapper/008:25:110
238589930,3cyclictest0-21swapper/008:10:010
238589930,3cyclictest0-21swapper/007:55:120
22449230,0sleep10-21swapper/110:13:551
238599921,1cyclictest0-21swapper/107:45:121
238599921,1cyclictest0-21swapper/107:15:121
238599920,1cyclictest2452-21chrt10:20:071
238599920,1cyclictest0-21swapper/110:25:091
238599920,1cyclictest0-21swapper/109:35:121
238599920,1cyclictest0-21swapper/109:15:011
238599920,1cyclictest0-21swapper/108:25:101
238599920,1cyclictest0-21swapper/108:10:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional