You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 11:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Mon Sep 07, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14682196178,13sleep30-21swapper/319:07:533
14702194178,12sleep00-21swapper/019:07:540
15742176161,11sleep10-21swapper/119:09:121
13402171152,14sleep20-21swapper/219:06:122
247542470,0sleep10-21swapper/100:20:131
56462110,0sleep00-21swapper/022:17:210
280432110,0sleep00-21swapper/023:49:380
4482100,0sleep30-21swapper/321:26:523
18359970,6cyclictest29899-21diskmemload23:35:113
18359966,0cyclictest40-21ksoftirqd/323:30:013
18359966,0cyclictest40-21ksoftirqd/323:30:013
18299962,3cyclictest0-21swapper/100:15:111
18299961,3cyclictest0-21swapper/121:35:121
18299961,3cyclictest0-21swapper/120:30:131
18299961,3cyclictest0-21swapper/119:15:131
18299961,3cyclictest0-21swapper/100:10:131
18259960,1cyclictest1637-21sh21:11:210
28999250,0sleep10-21swapper/121:56:581
18359955,0cyclictest16177-21kworker/3:122:35:393
18359955,0cyclictest16177-21kworker/3:100:05:123
18359954,1cyclictest40-21ksoftirqd/319:25:003
18359954,1cyclictest16177-21kworker/3:123:42:493
18359950,5cyclictest0-21swapper/323:52:163
18359950,5cyclictest0-21swapper/322:55:573
18359950,5cyclictest0-21swapper/300:30:113
18359950,5cyclictest0-21swapper/300:17:523
18359950,4cyclictest2072-21df23:20:133
18319953,2cyclictest20059-21kworker/2:023:03:222
18319953,2cyclictest20059-21kworker/2:000:36:042
18319950,5cyclictest21190-21ssh22:09:332
18319950,0cyclictest81rcu_preempt20:35:002
18319950,0cyclictest0-21swapper/200:18:282
18299953,1cyclictest0-21swapper/123:55:121
18299952,2cyclictest3767-21chrt23:53:261
18299952,2cyclictest0-21swapper/121:40:131
18299952,2cyclictest0-21swapper/121:20:121
18299952,2cyclictest0-21swapper/119:55:121
18299952,2cyclictest0-21swapper/119:40:141
18299951,3cyclictest0-21swapper/119:20:101
18299951,2cyclictest0-21swapper/123:05:121
18299951,2cyclictest0-21swapper/120:05:131
18299950,5cyclictest0-21swapper/121:48:331
18259951,3cyclictest802-21snmpd22:11:030
18259950,5cyclictest0-21swapper/023:52:420
11485250,0sleep20-21swapper/200:13:302
7071240,0sleep00-21swapper/021:30:180
25118240,0sleep10-21swapper/100:04:191
18359944,0cyclictest40-21ksoftirqd/321:10:013
18359944,0cyclictest40-21ksoftirqd/300:20:133
18359944,0cyclictest16177-21kworker/3:122:13:153
18359944,0cyclictest0-21swapper/323:55:013
18359944,0cyclictest0-21swapper/320:00:013
18359943,1cyclictest7733-21grep20:25:003
18359943,1cyclictest40-21ksoftirqd/322:40:133
18359943,1cyclictest21860-21ssh00:35:123
18359943,1cyclictest18304-21cut19:40:153
18359942,1cyclictest802-21snmpd20:40:443
18359942,1cyclictest17965-21ssh22:07:333
18359942,1cyclictest11599-21ntpq20:30:173
18359940,4cyclictest16779-21python19:35:193
18359940,4cyclictest0-21swapper/323:45:113
18359940,4cyclictest0-21swapper/323:15:123
18359940,4cyclictest0-21swapper/323:05:123
18359940,4cyclictest0-21swapper/321:45:423
18359940,4cyclictest0-21swapper/321:40:143
18359940,4cyclictest0-21swapper/321:30:143
18359940,4cyclictest0-21swapper/300:00:133
18359940,3cyclictest8028-21ssh21:15:093
18359940,3cyclictest6927-21ssh00:10:353
18359940,3cyclictest3524-21ssh22:32:253
18359940,3cyclictest25188-21/usr/sbin/munin21:00:133
18359940,3cyclictest25160-21/usr/sbin/munin19:55:133
18359940,3cyclictest24876-21df21:55:123
18359940,3cyclictest24083-21ssh23:30:373
18359940,3cyclictest2191-21sed22:15:203
18359940,3cyclictest21089-21ssh21:20:493
18359940,3cyclictest20479-21/usr/sbin/munin22:25:143
18359940,3cyclictest1769-21ssh21:11:263
18359940,3cyclictest14492-21cut23:10:153
18359940,3cyclictest14259-21ssh21:50:143
18359940,3cyclictest13174-21seq20:35:133
18359940,3cyclictest10925-21ssh22:04:353
18359940,3cyclictest10325-21ssh22:20:073
18359940,3cyclictest0-21swapper/322:50:153
18359940,3cyclictest0-21swapper/322:45:353
18359940,3cyclictest0-21swapper/319:10:023
18359940,3cyclictest0-21swapper/300:25:203
18359940,1cyclictest81rcu_preempt23:00:143
18359940,0cyclictest0-21swapper/321:37:403
18319944,0cyclictest7417-21ssh00:27:302
18319944,0cyclictest31-21ksoftirqd/223:20:142
18319944,0cyclictest31-21ksoftirqd/220:00:202
18319944,0cyclictest0-21swapper/223:50:062
18319944,0cyclictest0-21swapper/222:57:172
18319944,0cyclictest0-21swapper/222:34:092
18319944,0cyclictest0-21swapper/200:21:142
18319944,0cyclictest0-21swapper/200:03:562
18319943,1cyclictest31-21ksoftirqd/222:25:002
18319943,1cyclictest31-21ksoftirqd/219:40:012
18319942,2cyclictest20059-21kworker/2:023:27:422
18319942,2cyclictest20059-21kworker/2:023:27:412
18319942,1cyclictest16418-21ssh23:43:352
18319940,4cyclictest9372-21rm23:55:422
18319940,4cyclictest22149-21df_inode23:30:152
18319940,4cyclictest18218-21apt-get21:20:122
18319940,4cyclictest14410-21diskstats23:10:162
18319940,4cyclictest1070-21ssh21:10:592
18319940,4cyclictest0-21swapper/223:17:462
18319940,4cyclictest0-21swapper/222:45:112
18319940,4cyclictest0-21swapper/222:40:142
18319940,4cyclictest0-21swapper/221:54:212
18319940,4cyclictest0-21swapper/221:45:142
18319940,4cyclictest0-21swapper/221:35:122
18319940,4cyclictest0-21swapper/220:05:132
18319940,3cyclictest8004-21tail22:50:232
18319940,3cyclictest4518-21sh22:00:352
18319940,3cyclictest27116-21ssh21:55:462
18319940,3cyclictest2414-21ssh22:15:212
18319940,3cyclictest20492-21ssh22:25:112
18319940,3cyclictest15202-21latency_hist20:40:002
18319940,3cyclictest0-21swapper/222:37:402
18319940,2cyclictest10286-21ssh23:08:102
18319940,1cyclictest0-21swapper/221:28:172
18299944,0cyclictest0-21swapper/122:42:581
18299944,0cyclictest0-21swapper/122:38:441
18299944,0cyclictest0-21swapper/119:37:081
18299942,1cyclictest7926-21chrt21:15:051
18299942,1cyclictest5325-21chrt22:33:321
18299942,1cyclictest21883-21chrt23:14:081
18299941,2cyclictest0-21swapper/123:40:131
18299941,2cyclictest0-21swapper/123:25:121
18299941,2cyclictest0-21swapper/123:25:121
18299941,2cyclictest0-21swapper/123:15:141
18299941,2cyclictest0-21swapper/122:45:121
18299941,2cyclictest0-21swapper/122:25:121
18299941,2cyclictest0-21swapper/122:10:141
18299941,2cyclictest0-21swapper/122:00:101
18299941,2cyclictest0-21swapper/121:10:131
18299941,2cyclictest0-21swapper/121:05:121
18299941,2cyclictest0-21swapper/120:55:121
18299941,2cyclictest0-21swapper/120:35:111
18299941,2cyclictest0-21swapper/120:20:131
18299941,2cyclictest0-21swapper/120:15:111
18299941,2cyclictest0-21swapper/120:10:131
18299941,2cyclictest0-21swapper/120:10:121
18299941,2cyclictest0-21swapper/120:00:131
18299941,2cyclictest0-21swapper/119:50:111
18299941,2cyclictest0-21swapper/119:30:131
18299941,2cyclictest0-21swapper/119:10:131
18299941,2cyclictest0-21swapper/100:35:131
18299941,2cyclictest0-21swapper/100:25:121
18299941,1cyclictest0-21swapper/123:35:121
18299941,1cyclictest0-21swapper/122:05:011
18299941,1cyclictest0-21swapper/100:30:121
18299940,4cyclictest0-21swapper/122:59:501
18299940,4cyclictest0-21swapper/121:25:431
18299940,0cyclictest0-21swapper/122:17:391
18259944,0cyclictest0-21swapper/023:32:280
18259944,0cyclictest0-21swapper/022:26:430
18259944,0cyclictest0-21swapper/000:13:310
18259943,1cyclictest29902-21kworker/0:220:05:040
18259942,1cyclictest802-21snmpd22:53:190
18259942,1cyclictest28083-21ssh21:25:010
18259941,3cyclictest27770-21awk00:05:170
18259941,2cyclictest0-21swapper/019:45:100
18259940,4cyclictest4019-21users00:25:200
18259940,4cyclictest3139-21ssh22:00:150
18259940,4cyclictest22693-21apt-get19:50:120
18259940,4cyclictest0-21swapper/023:42:230
18259940,4cyclictest0-21swapper/023:09:290
18259940,4cyclictest0-21swapper/022:56:150
18259940,4cyclictest0-21swapper/022:34:040
18259940,4cyclictest0-21swapper/021:48:260
18259940,4cyclictest0-21swapper/021:44:260
18259940,4cyclictest0-21swapper/020:20:130
18259940,4cyclictest0-21swapper/020:00:010
18259940,4cyclictest0-21swapper/000:30:110
18259940,3cyclictest7695-21hddtemp_smartct23:55:150
18259940,3cyclictest31002-21ssh23:18:310
18259940,3cyclictest24007-21latency_hist21:55:000
18259940,3cyclictest15220-21sed20:40:010
18259940,1cyclictest2129-21/usr/sbin/munin19:10:140
18259940,1cyclictest19741-21sed21:20:180
18259940,1cyclictest15093-21grep00:15:140
18259940,0cyclictest0-21swapper/023:35:570
18259940,0cyclictest0-21swapper/022:35:080
18259940,0cyclictest0-21swapper/022:22:290
17329240,1sleep016764-21/usr/sbin/munin00:00:140
13532240,0sleep10-21swapper/122:21:001
18359933,0cyclictest40-21ksoftirqd/320:50:113
18359930,3cyclictest4150-21grep20:15:183
18359930,3cyclictest30374-21/usr/sbin/munin20:05:203
18359930,3cyclictest0-21swapper/320:45:053
18359930,3cyclictest0-21swapper/320:25:103
18359930,3cyclictest0-21swapper/319:50:123
18359930,3cyclictest0-21swapper/319:45:043
18359930,3cyclictest0-21swapper/319:30:153
18359930,3cyclictest0-21swapper/319:25:053
18359930,3cyclictest0-21swapper/319:15:013
18359930,1cyclictest0-21swapper/320:55:113
18359930,0cyclictest0-21swapper/320:10:043
18359930,0cyclictest0-21swapper/320:10:033
18319933,0cyclictest4605-21kworker/2:120:25:012
18319933,0cyclictest4605-21kworker/2:120:20:012
18319932,1cyclictest31365-21ssh23:35:042
18319932,1cyclictest18133-21expr20:45:142
18319932,1cyclictest10846-21df19:25:132
18319931,1cyclictest802-21snmpd20:10:042
18319931,1cyclictest802-21snmpd20:10:042
18319931,1cyclictest19989-21latency_hist19:45:002
18319930,3cyclictest8844-21fschecks_time21:15:162
18319930,3cyclictest4780-21ntp_states19:15:002
18319930,3cyclictest29899-21diskmemload00:30:062
18319930,3cyclictest28187-21diskstats21:05:142
18319930,3cyclictest0-21swapper/223:45:122
18319930,3cyclictest0-21swapper/222:10:152
18319930,3cyclictest0-21swapper/221:40:142
18319930,3cyclictest0-21swapper/221:30:022
18319930,3cyclictest0-21swapper/221:00:112
18319930,3cyclictest0-21swapper/220:55:152
18319930,3cyclictest0-21swapper/220:50:092
18319930,3cyclictest0-21swapper/220:40:082
18319930,3cyclictest0-21swapper/220:15:112
18319930,3cyclictest0-21swapper/219:55:122
18319930,3cyclictest0-21swapper/219:51:012
18319930,3cyclictest0-21swapper/219:40:072
18319930,3cyclictest0-21swapper/219:30:122
18319930,3cyclictest0-21swapper/219:10:132
18319930,3cyclictest0-21swapper/200:05:112
18319930,0cyclictest81rcu_preempt19:20:112
18299932,1cyclictest24489-21chrt23:30:521
18299932,1cyclictest20205-21chrt19:45:021
18299932,1cyclictest19775-21chrt20:47:221
18299931,2cyclictest0-21swapper/123:45:001
18299931,1cyclictest0-21swapper/123:20:131
18299931,1cyclictest0-21swapper/122:50:141
18299931,1cyclictest0-21swapper/121:50:161
18299931,1cyclictest0-21swapper/121:30:151
18299931,1cyclictest0-21swapper/120:50:111
18299931,1cyclictest0-21swapper/120:40:111
18299930,2cyclictest0-21swapper/123:00:131
18299930,2cyclictest0-21swapper/121:00:121
18299930,2cyclictest0-21swapper/120:25:111
18299930,2cyclictest0-21swapper/119:25:111
18299930,2cyclictest0-21swapper/100:05:141
18259933,0cyclictest29902-21kworker/0:223:00:010
18259933,0cyclictest29902-21kworker/0:220:10:090
18259933,0cyclictest29902-21kworker/0:220:10:080
18259932,1cyclictest28279-21ssh22:45:100
18259932,1cyclictest24210-21ssh00:20:050
18259931,1cyclictest0-21swapper/020:40:120
18259930,3cyclictest8523-21perl19:20:130
18259930,3cyclictest61-21kswapd022:05:020
18259930,3cyclictest5366-21apt-get19:15:110
18259930,3cyclictest27969-21tr20:00:140
18259930,3cyclictest23200-21ls20:55:130
18259930,3cyclictest17756-21/usr/sbin/munin20:45:110
18259930,3cyclictest15259-21/usr/sbin/munin19:35:140
18259930,3cyclictest14519-21tune2fs23:10:150
18259930,3cyclictest1369-21ssh23:20:080
18259930,3cyclictest11042-21grep20:30:140
18259930,3cyclictest0-21swapper/022:40:130
18259930,3cyclictest0-21swapper/021:55:120
18259930,3cyclictest0-21swapper/021:35:130
18259930,3cyclictest0-21swapper/021:15:130
18259930,3cyclictest0-21swapper/021:05:130
18259930,3cyclictest0-21swapper/021:00:110
18259930,3cyclictest0-21swapper/020:50:110
18259930,3cyclictest0-21swapper/020:15:050
18259930,3cyclictest0-21swapper/019:40:130
18259930,3cyclictest0-21swapper/019:30:020
18259930,3cyclictest0-21swapper/019:25:120
18259930,2cyclictest7859-21/usr/sbin/munin20:25:110
18259930,2cyclictest11324-21ssh23:25:050
18259930,2cyclictest11324-21ssh23:25:040
18259930,1cyclictest21647-21ssh00:35:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional