You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 16:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Mar 17, 2026 12:44:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1598227300,9sleep30-21swapper/307:05:083
159879911069,35cyclictest0-21swapper/208:55:362
159879911069,35cyclictest0-21swapper/208:55:362
159879910744,12cyclictest0-21swapper/207:55:252
159879910645,11cyclictest0-21swapper/212:10:072
14651210414,59sleep014684-21cut07:00:290
3071021030,8sleep30-21swapper/310:10:253
159879910257,12cyclictest13277-21mailstats09:40:402
159879910257,12cyclictest13277-21mailstats09:40:402
15987991003,42cyclictest24398-21latency_hist10:00:062
1598799982,41cyclictest27447-21grep07:35:402
15979999816,72cyclictest10811-21apt-get11:25:191
1454329711,60sleep214590-21ls07:00:232
15967999650,15cyclictest58-21kcompactd007:20:040
1597999933,58cyclictest32665-21ssh09:20:451
1597999918,54cyclictest20188-21cstates07:15:441
15979999064,17cyclictest19838-21latency_hist07:15:071
15967998966,16cyclictest9368-21sh12:15:380
15967998851,15cyclictest181rcu_preempt07:30:190
15987998766,16cyclictest14192-21timerandwakeup08:35:382
1599299864,40cyclictest0-21swapper/309:30:213
15987998660,16cyclictest0-21swapper/207:50:052
15987998660,16cyclictest0-21swapper/207:50:052
15979998623,50cyclictest0-21swapper/110:15:141
15987998567,11cyclictest0-21swapper/209:10:312
15987998561,13cyclictest0-21swapper/208:55:062
15967998557,17cyclictest0-21swapper/007:20:310
15987998464,15cyclictest15960-21cyclictest10:20:322
1596799844,67cyclictest29086-21fschecks_count11:55:250
15967998445,12cyclictest181rcu_preempt10:35:150
15987998362,14cyclictest30547-21sh10:10:192
15979998352,22cyclictest5929-21latency_hist09:30:061
1596799833,58cyclictest10929-21ssh11:25:310
15987998262,14cyclictest18728-21fschecks_count09:50:262
1597999828,34cyclictest0-21swapper/110:10:391
15979998256,19cyclictest31427-21cstates07:50:211
1597999823,66cyclictest6480-21apt-get09:30:211
15967998264,10cyclictest0-21swapper/009:15:140
15967998252,12cyclictest181rcu_preempt11:15:170
15992998113,41cyclictest0-21swapper/311:25:203
15987998162,11cyclictest0-21swapper/210:26:582
15987998158,16cyclictest11507-21ssh10:31:432
15987998155,19cyclictest17270-21kworker/u17:0+events_unbound09:50:032
15987998154,19cyclictest8496-21sh12:15:182
15987998146,11cyclictest181rcu_preempt11:40:182
15987998143,9cyclictest181rcu_preempt11:30:152
15979998153,20cyclictest31925-21latency_hist09:20:071
15967998165,11cyclictest14968-21ntp_offset12:25:330
15987998063,12cyclictest1362-21kworker/u17:2-rpciod12:13:072
15987998061,11cyclictest0-21swapper/207:35:072
15987998057,13cyclictest0-21swapper/208:10:072
1598799802,49cyclictest26043-21ssh11:50:262
15979998059,14cyclictest9677-21kworker/u17:2-ext4-rsv-conversion08:55:071
15979998056,13cyclictest0-21swapper/112:10:261
1596799806,60cyclictest3340-21ssh09:25:280
15987997958,15cyclictest58-21kcompactd009:29:462
15987997956,14cyclictest0-21swapper/208:45:062
15987997951,9cyclictest181rcu_preempt10:10:072
1599299786,51cyclictest0-21swapper/309:20:453
15987997860,11cyclictest0-21swapper/211:10:072
15987997858,11cyclictest0-21swapper/207:30:062
15987997856,12cyclictest0-21swapper/210:45:072
15987997847,18cyclictest15960-21cyclictest09:07:252
1598799783,41cyclictest22662-21ntp_states10:50:362
15979997858,14cyclictest15788-21threads08:40:391
15979997845,23cyclictest15823-21kworker/u18:1+nfsiod12:07:111
15979997838,32cyclictest22039-21ssh10:50:151
15967997858,13cyclictest15960-21cyclictest09:41:060
15967997858,13cyclictest15960-21cyclictest09:41:060
15967997858,12cyclictest31294-21kworker/u19:0+events_unbound10:35:060
15967997854,16cyclictest27762-21ssh11:53:050
15987997758,12cyclictest0-21swapper/208:10:372
15987997756,9cyclictest0-21swapper/210:15:242
15987997756,14cyclictest6298-21kworker/u17:1-nfsiod11:20:432
15987997748,20cyclictest2627-21tail11:10:412
15987997745,11cyclictest181rcu_preempt09:30:402
15979997728,30cyclictest10185-21apt-get08:25:201
15979997716,30cyclictest11931-21ntpq12:20:321
15979997716,30cyclictest11931-21ntpq12:20:321
15967997763,9cyclictest18349-21ssh11:36:520
15967997755,14cyclictest5452-21ssh12:10:200
1596799775,34cyclictest9808-21fschecks_time09:35:260
15967997753,15cyclictest200-21systemd-journal10:16:170
15967997744,8cyclictest181rcu_preempt12:06:250
15967997744,12cyclictest22565-21kworker/u18:1-ext4-rsv-conversion08:35:390
15967997736,29cyclictest2295-21cut08:00:240
15987997657,9cyclictest0-21swapper/207:10:312
15987997655,12cyclictest0-21swapper/210:40:062
15987997641,12cyclictest181rcu_preempt07:50:392
15979997659,11cyclictest298-21in:imuxsock09:10:041
15979997652,16cyclictest18727-21fschecks_count09:50:261
15979997642,24cyclictest32120-21cut12:00:261
15979997642,24cyclictest32120-21cut12:00:261
15967997658,8cyclictest0-21swapper/009:45:400
1596799763,30cyclictest23926-21processes09:05:360
15967997630,29cyclictest17908-21timerandwakeup07:10:140
1599299752,59cyclictest26237-21chrt09:10:183
15987997559,8cyclictest0-21swapper/211:00:132
15987997556,10cyclictest0-21swapper/211:00:062
15987997556,10cyclictest0-21swapper/211:00:062
15987997555,11cyclictest0-21swapper/207:20:062
15987997551,16cyclictest15960-21cyclictest09:35:262
15979997533,33cyclictest4100-21ssh10:20:191
15967997555,14cyclictest22889-21latency_hist09:05:060
15967997553,15cyclictest28578-21needreboot11:00:300
15967997527,12cyclictest181rcu_preempt08:50:030
1599299742,37cyclictest17597-21chrt07:10:063
15987997421,11cyclictest181rcu_preempt08:25:052
15987997421,11cyclictest181rcu_preempt08:25:052
15987997420,10cyclictest25574-21cat11:50:052
15979997422,39cyclictest26495-21acpi07:35:141
15979997422,39cyclictest24649-21cat07:30:061
15979997419,20cyclictest5225-21ntp_states11:15:331
15979997414,29cyclictest17539-21df12:30:211
15967997454,15cyclictest27188-21latency_hist10:05:070
1596799745,35cyclictest352-21runrttasks09:30:320
15967997438,14cyclictest15878-21timerwakeupswit08:40:400
1599299733,57cyclictest30544-21chrt07:45:383
1599299733,57cyclictest30544-21chrt07:45:383
15987997356,9cyclictest0-21swapper/207:45:052
15987997356,9cyclictest0-21swapper/207:45:052
15987997352,10cyclictest0-21swapper/208:30:062
15979997324,37cyclictest0-21swapper/107:40:161
15979997324,37cyclictest0-21swapper/107:40:161
15979997318,28cyclictest28236-21ssh11:00:211
15979997314,22cyclictest7450-21/usr/sbin/munin10:25:271
15979997312,27cyclictest0-21swapper/109:35:251
15967997352,14cyclictest2705-21cron09:25:030
15967997341,23cyclictest0-21swapper/010:10:060
15967997329,13cyclictest181rcu_preempt08:20:410
15967997329,13cyclictest181rcu_preempt08:20:410
1596799732,60cyclictest1745-21expr11:10:210
1449827310,37sleep114542-21/usr/sbin/munin07:00:221
1599299723,36cyclictest27083-21chrt11:51:113
15987997257,9cyclictest19839-21diskmemload12:34:322
15987997254,11cyclictest0-21swapper/207:10:072
15987997250,12cyclictest0-21swapper/208:30:262
15979997254,11cyclictest15960-21cyclictest08:02:361
1597999724,48cyclictest13561-21grep09:40:431
1597999724,48cyclictest13561-21grep09:40:431
15967997256,10cyclictest31388-21cpuspeed07:50:200
1599299713,53cyclictest32279-21chrt09:20:073
15987997154,9cyclictest0-21swapper/208:50:052
15987997154,10cyclictest15960-21cyclictest12:26:192
15987997148,15cyclictest200-21systemd-journal10:46:172
15987997148,15cyclictest200-21systemd-journal10:46:172
1597999717,36cyclictest0-21swapper/111:06:331
1597999716,31cyclictest0-21swapper/112:30:051
15979997152,12cyclictest28632-21sshd10:05:451
15979997144,15cyclictest0-21swapper/109:45:251
15979997129,30cyclictest13034-21apt-get10:35:141
15967997151,14cyclictest803-21sendmail-mta07:35:400
15967997148,15cyclictest30470-21/usr/sbin/munin10:10:410
1596799714,33cyclictest14365-21awk11:30:300
1596799713,58cyclictest7057-21ssh10:25:150
15967997119,24cyclictest25932-21cat10:55:390
15967997119,24cyclictest25932-21cat10:55:390
15987997047,16cyclictest15960-21cyclictest08:15:282
15987997047,16cyclictest15960-21cyclictest08:15:282
15987997044,19cyclictest17665-21kworker/u17:0+events_unbound09:05:032
15979997049,13cyclictest15960-21cyclictest10:45:321
15979997049,13cyclictest15960-21cyclictest10:45:321
15979997048,12cyclictest0-21swapper/111:45:391
15979997023,39cyclictest25787-21/usr/sbin/munin11:50:371
15967997053,9cyclictest0-21swapper/012:05:060
15967997053,9cyclictest0-21swapper/012:05:060
15967997053,8cyclictest0-21swapper/011:20:220
15967997052,11cyclictest15960-21cyclictest09:51:070
15967997048,12cyclictest21120-21diskmemload10:48:240
15967997048,12cyclictest21120-21diskmemload10:48:240
1596799704,33cyclictest17568-21/usr/sbin/munin12:30:240
1596799703,55cyclictest11160-21grep08:25:410
15987996943,16cyclictest0-21swapper/209:15:402
15979996946,15cyclictest29060-21sh09:15:061
15979996942,19cyclictest14239-21cut11:30:281
1596799695,34cyclictest11348-21/usr/sbin/munin12:20:410
1596799695,34cyclictest11348-21/usr/sbin/munin12:20:410
15967996939,9cyclictest181rcu_preempt08:10:190
15967996931,8cyclictest181rcu_preempt07:45:190
15967996931,8cyclictest181rcu_preempt07:45:190
1599299684,31cyclictest19563-21chrt08:54:143
1599299683,51cyclictest6471-21chrt11:17:473
1599299682,53cyclictest16911-21chrt08:45:233
1599299682,34cyclictest16633-21chrt10:40:313
1599299682,32cyclictest20536-21chrt07:15:533
1599299682,30cyclictest24005-21chrt11:45:563
15987996853,11cyclictest15960-21cyclictest11:15:402
15987996847,15cyclictest200-21systemd-journal10:03:172
15979996845,13cyclictest0-21swapper/111:55:291
1596799685,47cyclictest17731-21munin-node09:55:120
15967996846,16cyclictest15960-21cyclictest10:24:090
1596799684,45cyclictest16622-21ntp_kernel_pll_10:40:310
15967996827,16cyclictest170-21jbd2/mmcblk2p2-808:55:200
15967996827,16cyclictest170-21jbd2/mmcblk2p2-808:55:200
1599299673,50cyclictest28463-21chrt10:05:383
1599299672,34cyclictest17976-21chrt12:30:333
1599299672,33cyclictest13355-21chrt08:35:073
1599299672,32cyclictest28128-21taskset07:40:193
1599299672,32cyclictest28128-21taskset07:40:193
15987996750,10cyclictest22901-21diskmemload12:04:092
15987996750,10cyclictest22901-21diskmemload12:04:092
15987996746,14cyclictest22901-21diskmemload11:55:462
15987996746,11cyclictest0-21swapper/211:35:412
1598799672,45cyclictest22032-21kworker/u18:1+ext4-rsv-conversion11:25:312
15979996744,14cyclictest24285-21latency_hist10:00:051
15979996742,12cyclictest0-21swapper/111:10:411
15979996738,19cyclictest22491-21latency_hist11:45:051
1597999673,34cyclictest23059-21latency_hist07:25:061
15979996728,32cyclictest0-21swapper/108:35:151
1596799676,33cyclictest23379-21ntpq11:45:310
15967996738,21cyclictest20356-21netstat11:40:310
15967996721,35cyclictest29457-21apt07:45:030
15967996721,35cyclictest29457-21apt07:45:030
1599299665,46cyclictest0-21swapper/310:35:143
1599299664,48cyclictest9847-21taskset10:30:063
1599299663,50cyclictest12524-21chrt09:40:183
1599299663,50cyclictest12524-21chrt09:40:183
1599299663,33cyclictest21259-21chrt08:59:573
1599299663,33cyclictest21259-21chrt08:59:573
1599299663,32cyclictest3454-21taskset12:05:413
1599299663,31cyclictest10071-21taskset12:17:203
1599299663,29cyclictest14799-21taskset08:40:053
1599299662,31cyclictest23419-21taskset09:05:243
15987996644,14cyclictest0-21swapper/212:20:232
15987996644,14cyclictest0-21swapper/212:20:232
15987996637,20cyclictest22990-21modprobe07:25:032
15979996646,9cyclictest0-21swapper/107:55:251
1597999663,43cyclictest9164-21proc_pri08:20:381
1597999663,43cyclictest9164-21proc_pri08:20:381
1597999663,42cyclictest5223-21latency_hist08:10:071
1597999662,31cyclictest7925-21fschecks_time11:20:271
1596799663,42cyclictest3976-21fschecks_time08:05:270
15967996633,13cyclictest26326-21cstates09:10:200
1599299653,50cyclictest12333-21chrt12:20:403
1599299653,50cyclictest12333-21chrt12:20:403
1599299653,30cyclictest28315-21chrt11:00:253
1599299653,30cyclictest11656-21chrt10:32:093
1599299653,29cyclictest1118-21chrt12:02:293
1599299653,29cyclictest1118-21chrt12:02:293
1599299652,51cyclictest31263-21chrt11:05:233
1599299652,32cyclictest19760-21chrt11:40:083
1598799653,45cyclictest32457-21/usr/sbin/munin09:21:402
15979996549,10cyclictest22901-21diskmemload10:30:381
15979996545,15cyclictest24819-21fschecks_time10:00:261
15979996545,10cyclictest0-21swapper/110:55:241
15979996545,10cyclictest0-21swapper/110:55:241
15979996526,31cyclictest5329-21apt-get08:10:151
15979996519,36cyclictest16956-21wc11:35:221
1596799654,48cyclictest352-21runrttasks11:08:030
1599299644,29cyclictest23671-21chrt09:58:373
1599299643,48cyclictest16222-21chrt09:45:373
1599299643,48cyclictest16077-21chrt11:33:563
1599299643,25cyclictest6022-21chrt12:10:353
1599299642,31cyclictest5898-21chrt10:22:443
1599299642,30cyclictest26517-21chrt07:35:173
1599299642,30cyclictest22854-21chrt07:23:183
1599299642,30cyclictest19019-21chrt09:50:313
1599299642,29cyclictest5487-21chrt09:28:513
1599299642,29cyclictest3478-21chrt10:19:203
1597999643,44cyclictest352-21runrttasks08:49:491
15979996422,35cyclictest25776-21unixbench_multi07:30:401
1596799643,34cyclictest11855-21cpuspeed08:30:190
15967996429,11cyclictest0-21swapper/010:50:290
1599299635,45cyclictest0-21swapper/308:10:153
1599299634,28cyclictest3414-21chrt08:04:413
1599299633,30cyclictest2369-21chrt11:10:383
1599299633,28cyclictest5087-21chrt08:10:043
1599299633,27cyclictest956-21chrt07:55:303
1599299632,31cyclictest27226-21chrt10:58:393
1599299632,31cyclictest27226-21chrt10:58:393
1599299632,29cyclictest9643-21chrt11:23:183
1599299632,29cyclictest8170-21chrt08:18:223
1599299632,29cyclictest8170-21chrt08:18:223
1599299632,29cyclictest31219-21chrt11:59:173
1599299632,29cyclictest23432-21chrt07:25:253
1599299632,28cyclictest20685-21chrt10:47:123
1599299632,28cyclictest20685-21chrt10:47:123
1597999634,43cyclictest29732-21cpu07:45:191
1597999634,43cyclictest29732-21cpu07:45:191
1597999633,42cyclictest16123-21/usr/sbin/munin07:05:361
1596799632,43cyclictest8396-21grep08:20:050
1596799632,43cyclictest8396-21grep08:20:050
1599299622,48cyclictest23383-21chrt10:51:213
1599299622,29cyclictest25827-21chrt10:01:173
1599299622,29cyclictest17053-21chrt11:35:263
1599299622,28cyclictest10943-21chrt09:36:373
1599299622,26cyclictest15563-21chrt08:40:333
15979996243,13cyclictest8447-21cpuspeed12:15:181
1597999623,36cyclictest8365-21latency_hist08:20:051
1597999623,36cyclictest8365-21latency_hist08:20:051
15979996227,23cyclictest11792-21apt-get08:30:191
1597999622,40cyclictest20904-21unixbench_singl08:55:411
1597999622,40cyclictest20904-21unixbench_singl08:55:411
1596799623,41cyclictest16391-21fschecks_time07:05:260
1599299613,29cyclictest16119-21chrt12:27:293
1599299613,28cyclictest9136-21chrt08:20:373
1599299613,28cyclictest9136-21chrt08:20:373
1599299613,27cyclictest25904-21chrt07:31:123
1599299612,27cyclictest32409-21chrt07:51:543
1599299612,27cyclictest11279-21chrt08:27:013
1597999618,21cyclictest16043-21apt-get10:40:151
15979996143,9cyclictest0-21swapper/109:00:251
15967996130,10cyclictest0-21swapper/007:55:230
1596799612,43cyclictest23250-21/usr/sbin/munin07:25:400
1599299603,27cyclictest19215-21chrt07:11:203
1599299593,25cyclictest22795-21chrt09:04:023
15987995914,31cyclictest2383-21cut08:00:252
1596799593,42cyclictest18314-21cpuspeed08:50:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional