You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 05:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Apr 14, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2130721046,16sleep10-21swapper/118:59:591
217079910244,14cyclictest181rcu_preempt23:53:140
2024629714,52sleep019676-21snmpd18:58:310
2170799943,68cyclictest11649-21apt-get00:13:320
2170799943,68cyclictest11649-21apt-get00:13:320
21707999057,8cyclictest181rcu_preempt22:58:250
2029728915,42sleep20-21swapper/218:58:332
21707998854,14cyclictest181rcu_preempt23:28:370
21713998772,10cyclictest18399-21switchtime22:33:481
21713998772,10cyclictest18399-21switchtime22:33:481
21707998664,8cyclictest181rcu_preempt22:27:150
21707998664,8cyclictest181rcu_preempt22:27:150
21707998654,8cyclictest181rcu_preempt23:48:160
21707998551,13cyclictest181rcu_preempt20:43:150
21717998421,26cyclictest39-21ksoftirqd/222:33:512
21717998421,26cyclictest39-21ksoftirqd/222:33:512
21707998411,44cyclictest15-21ksoftirqd/021:33:370
21707998355,21cyclictest27450-21latency_hist20:58:170
21707998350,12cyclictest181rcu_preempt22:06:180
21707998350,12cyclictest181rcu_preempt22:06:180
21707998338,18cyclictest181rcu_preempt00:27:520
21707998314,30cyclictest15-21ksoftirqd/023:58:350
21717998253,20cyclictest22935-21sh00:33:142
21713998260,14cyclictest300-21rs:main1
21707998233,17cyclictest0-21swapper/023:10:550
21707998233,17cyclictest0-21swapper/023:10:550
21707998232,11cyclictest181rcu_preempt21:18:160
21707998232,11cyclictest181rcu_preempt21:18:160
21707998147,8cyclictest181rcu_preempt20:48:310
21707998146,20cyclictest181rcu_preempt22:08:450
21707998146,20cyclictest181rcu_preempt22:08:450
21707998141,15cyclictest181rcu_preempt19:48:360
21713998062,12cyclictest297-21systemd-logind22:53:141
21707998049,10cyclictest181rcu_preempt22:53:400
21707998036,17cyclictest181rcu_preempt22:19:460
21707998020,21cyclictest0-21swapper/020:22:000
21707998019,22cyclictest0-21swapper/022:02:020
21713997962,11cyclictest297-21systemd-logind00:08:151
21713997961,14cyclictest28969-21kworker/u19:3+events_unbound23:03:131
21713997960,13cyclictest2967-21if_eth023:58:381
21713997958,15cyclictest4957-21sh22:12:051
21713997958,15cyclictest4957-21sh22:12:051
2170799797,32cyclictest15-21ksoftirqd/000:08:240
2170799797,32cyclictest15-21ksoftirqd/000:08:240
21707997937,16cyclictest181rcu_preempt21:46:030
21707997937,16cyclictest181rcu_preempt21:46:030
21707997935,17cyclictest21693-21cyclictest23:41:350
21707997935,13cyclictest181rcu_preempt00:08:160
21707997928,11cyclictest181rcu_preempt22:41:280
21717997846,21cyclictest2544-21latency_hist21:13:172
21717997844,23cyclictest23995-21modprobe20:48:132
21717997838,11cyclictest3845-21ssh22:08:542
21717997838,11cyclictest3845-21ssh22:08:542
21713997858,14cyclictest24510-21processes19:08:481
21713997856,15cyclictest11715-21proc_pri20:09:441
21707997860,11cyclictest297-21systemd-logind19:13:140
21707997846,7cyclictest181rcu_preempt19:33:510
21707997846,7cyclictest181rcu_preempt19:33:510
21707997843,12cyclictest181rcu_preempt21:54:060
21707997840,9cyclictest181rcu_preempt21:28:510
21707997832,25cyclictest11364-21date23:18:160
21707997832,25cyclictest11364-21date23:18:160
21717997757,14cyclictest31891-21sh22:03:132
21717997737,12cyclictest15296-21ssh22:28:492
21713997762,10cyclictest21693-21cyclictest00:18:511
21713997759,12cyclictest2952-21systemd-journal20:23:151
21713997758,13cyclictest352-21runrttasks21:08:041
21707997746,16cyclictest181rcu_preempt20:13:360
21707997738,10cyclictest181rcu_preempt23:03:400
21717997638,9cyclictest181rcu_preempt22:44:312
21717997635,10cyclictest9583-21ssh00:08:562
21717997635,10cyclictest9583-21ssh00:08:562
2171799763,49cyclictest5992-21ssh22:13:372
2171799763,49cyclictest5992-21ssh22:13:372
2171799762,52cyclictest11078-21apt-get20:08:342
21713997656,14cyclictest17968-21ntp_offset23:28:441
21707997642,26cyclictest0-21swapper/021:48:420
21707997637,12cyclictest181rcu_preempt23:22:140
21717997555,14cyclictest5953-21fschecks_time21:18:372
21717997550,7cyclictest181rcu_preempt21:23:442
21717997550,7cyclictest181rcu_preempt21:23:442
21713997556,13cyclictest22647-21/usr/sbin/munin20:43:251
21713997555,14cyclictest1395-21sh23:55:481
21707997544,12cyclictest181rcu_preempt20:46:020
21707997543,11cyclictest181rcu_preempt23:27:520
21707997543,11cyclictest181rcu_preempt23:27:520
21707997533,8cyclictest181rcu_preempt21:18:210
21707997533,8cyclictest181rcu_preempt00:21:270
21707997530,22cyclictest0-21swapper/019:53:490
21717997457,11cyclictest26532-21idleruntime23:43:382
21717997457,10cyclictest5324-21munin-plugin-st23:08:162
21717997452,12cyclictest0-21swapper/220:13:312
21717997447,8cyclictest181rcu_preempt22:55:262
21717997446,7cyclictest181rcu_preempt23:26:352
21717997446,7cyclictest181rcu_preempt23:26:352
21717997421,25cyclictest39-21ksoftirqd/219:08:062
21713997459,9cyclictest1-21systemd20:38:161
21707997440,12cyclictest181rcu_preempt21:03:550
21707997438,16cyclictest181rcu_preempt00:28:400
21707997437,8cyclictest181rcu_preempt20:26:570
21707997437,12cyclictest181rcu_preempt22:35:410
21707997437,12cyclictest181rcu_preempt22:35:410
2170799743,42cyclictest28863-21diskmemload22:28:520
21707997427,39cyclictest0-21swapper/022:48:250
21717997340,10cyclictest181rcu_preempt23:12:462
21717997340,10cyclictest181rcu_preempt23:12:462
21717997317,29cyclictest39-21ksoftirqd/219:59:492
21717997317,29cyclictest39-21ksoftirqd/219:59:492
21713997357,8cyclictest0-21swapper/119:58:501
21713997357,8cyclictest0-21swapper/119:58:501
21713997353,14cyclictest3493-21sh21:14:161
21713997353,14cyclictest3493-21sh21:14:161
21713997351,15cyclictest4611-21fschecks_time19:48:361
21713997346,20cyclictest8363-21kworker/u18:1+nfsiod21:29:091
21707997356,12cyclictest22946-21latency_hist23:38:150
21707997352,7cyclictest181rcu_preempt23:54:050
21707997346,7cyclictest181rcu_preempt20:30:370
21707997339,17cyclictest21693-21cyclictest21:10:150
21707997339,12cyclictest295250systemd-journal21:03:140
21707997338,7cyclictest181rcu_preempt20:03:310
21707997335,16cyclictest181rcu_preempt22:45:550
21707997322,20cyclictest0-21swapper/019:33:160
21707997322,20cyclictest0-21swapper/019:33:160
21717997254,13cyclictest23133-21latency_hist22:43:172
21717997251,15cyclictest544-21cron22:53:132
21717997250,12cyclictest0-21swapper/220:03:472
21717997244,10cyclictest181rcu_preempt21:41:332
21717997235,7cyclictest181rcu_preempt19:30:252
21717997235,7cyclictest181rcu_preempt19:30:252
21717997232,13cyclictest39-21ksoftirqd/220:30:532
21713997255,11cyclictest28765-21/usr/sbin/munin19:23:431
21707997239,10cyclictest181rcu_preempt20:09:460
21707997238,11cyclictest181rcu_preempt21:39:010
21707997236,8cyclictest181rcu_preempt19:13:280
21707997224,19cyclictest0-21swapper/020:33:500
21717997155,9cyclictest5928-21latency_hist19:53:172
21717997155,11cyclictest352-21runrttasks23:13:212
21717997155,11cyclictest352-21runrttasks23:13:212
21717997149,15cyclictest1-21systemd19:08:282
21717997146,18cyclictest3601-21unixbench_multi23:58:512
21717997145,7cyclictest181rcu_preempt21:53:432
21713997153,12cyclictest22948-21apt-key00:33:161
21713997117,15cyclictest9683-21memory20:03:381
21707997139,8cyclictest181rcu_preempt19:43:400
21707997133,8cyclictest181rcu_preempt19:43:170
21707997125,24cyclictest0-21swapper/019:27:130
21707997124,23cyclictest0-21swapper/019:59:440
21707997124,23cyclictest0-21swapper/019:59:440
21707997119,22cyclictest15-21ksoftirqd/019:06:020
21717997052,9cyclictest0-21swapper/221:03:152
21717997036,26cyclictest14975-21sed21:33:402
21717997033,9cyclictest181rcu_preempt23:39:462
21713997054,10cyclictest20122-21ssh21:43:151
21713997053,10cyclictest26948-21sshd20:54:291
21713997050,14cyclictest11203-21idleruntime-cro23:18:131
21713997050,14cyclictest11203-21idleruntime-cro23:18:131
21713997048,15cyclictest544-21cron19:08:141
21707997045,11cyclictest181rcu_preempt22:13:190
21707997045,11cyclictest181rcu_preempt22:13:190
21707997039,17cyclictest181rcu_preempt21:24:120
21707997039,17cyclictest181rcu_preempt21:24:120
2171799697,32cyclictest39-21ksoftirqd/221:17:002
2171799697,32cyclictest39-21ksoftirqd/221:17:002
21717996942,8cyclictest181rcu_preempt21:50:042
21717996934,8cyclictest381ktimers/221:48:152
21717996934,8cyclictest381ktimers/221:48:152
21717996926,30cyclictest31822-21modprobe21:08:132
21717996921,20cyclictest371rcuc/219:33:372
21717996921,20cyclictest371rcuc/219:33:372
21717996920,20cyclictest371rcuc/220:33:462
21713996955,7cyclictest0-21swapper/122:23:141
21713996955,10cyclictest21693-21cyclictest22:00:131
21713996948,15cyclictest11152-21apt-key00:13:151
21713996948,15cyclictest11152-21apt-key00:13:151
2171399694,47cyclictest27131-21latency_hist19:18:171
2171399692,33cyclictest509650ssh23:07:371
21713996912,42cyclictest21243-21timerwakeupswit23:33:501
21717996854,8cyclictest0-21swapper/200:23:472
21717996847,16cyclictest21693-21cyclictest22:18:482
21717996840,8cyclictest181rcu_preempt23:28:372
21717996833,9cyclictest181rcu_preempt23:48:222
21717996832,7cyclictest181rcu_preempt19:43:592
21717996831,10cyclictest32009-21ssh23:53:182
21713996854,10cyclictest21693-21cyclictest00:18:111
21713996854,10cyclictest21693-21cyclictest00:18:111
21713996852,9cyclictest0-21swapper/122:58:131
21713996849,13cyclictest11218-21latency_hist21:28:171
21713996849,13cyclictest11218-21latency_hist21:28:171
21713996847,15cyclictest300-21rs:main1
21713996846,16cyclictest1-21systemd21:22:281
21717996735,7cyclictest181rcu_preempt19:40:262
21717996734,8cyclictest181rcu_preempt19:20:262
21717996733,7cyclictest181rcu_preempt23:00:272
21717996733,7cyclictest181rcu_preempt22:25:362
21717996733,7cyclictest181rcu_preempt22:25:362
21717996714,21cyclictest39-21ksoftirqd/200:20:172
21713996753,8cyclictest0-21swapper/122:43:091
21713996751,11cyclictest0-21swapper/120:53:161
21713996746,15cyclictest14640-21/usr/sbin/munin22:28:321
21713996743,19cyclictest27333-21sh21:53:531
21713996710,23cyclictest16423-21sh23:26:261
21713996710,23cyclictest16423-21sh23:26:261
21707996727,20cyclictest0-21swapper/019:19:330
21717996647,13cyclictest26375-21netstat20:53:412
21717996635,7cyclictest181rcu_preempt23:20:112
2171799663,26cyclictest12328-21cat21:28:482
21717996628,9cyclictest13308-21ssh00:15:552
21717996628,9cyclictest13308-21ssh00:15:552
21717996616,22cyclictest39-21ksoftirqd/219:27:292
21713996637,20cyclictest14039-21cron20:18:131
21713996619,11cyclictest17343-21munin-run20:28:151
21717996551,8cyclictest0-21swapper/219:53:352
21717996546,9cyclictest0-21swapper/223:33:522
2171799652,25cyclictest7517-21ssh00:06:282
21717996514,26cyclictest39-21ksoftirqd/220:23:592
2171399655,43cyclictest5373-21apt-get22:13:231
2171399655,43cyclictest5373-21apt-get22:13:231
21713996550,11cyclictest21693-21cyclictest19:43:381
21713996549,11cyclictest21693-21cyclictest21:48:511
2171399654,44cyclictest15544-21unixbench_multi21:33:521
21713996543,17cyclictest1-21systemd23:53:151
2171399653,47cyclictest28215-21switchtime20:58:471
2171399653,28cyclictest1485950kworker/u17:1+xprtiod23:41:461
21713996518,14cyclictest31786-21munin-run19:33:151
21713996518,14cyclictest31786-21munin-run19:33:151
21717996430,7cyclictest181rcu_preempt20:39:592
21717996429,10cyclictest58-21kcompactd022:05:132
21717996429,10cyclictest58-21kcompactd022:05:132
21713996446,13cyclictest2349-21latency_hist21:13:161
21713996443,15cyclictest17922-21grep00:23:431
2171399643,44cyclictest572-21switchtime22:03:501
2171399643,44cyclictest572-21switchtime22:03:501
21717996348,10cyclictest2952-21systemd-journal19:16:282
2171799634,25cyclictest39-21ksoftirqd/220:48:272
2171399635,46cyclictest352-21runrttasks21:44:201
2171399635,46cyclictest352-21runrttasks21:44:201
21713996347,11cyclictest27154-21/usr/sbin/munin19:18:411
21713996345,12cyclictest17559-21/usr/sbin/munin20:28:431
21713996345,11cyclictest277-21dbus-daemon19:58:151
21713996344,12cyclictest0-21swapper/123:43:311
21713996339,18cyclictest23857-21kernelversion22:43:391
2171399633,44cyclictest12599-21cat22:23:501
2171399633,44cyclictest12599-21cat22:23:501
21713996248,9cyclictest0-21swapper/119:33:501
21713996248,9cyclictest0-21swapper/119:33:501
21713996246,9cyclictest0-21swapper/123:08:281
21713996246,9cyclictest0-21swapper/123:08:281
2171799615,25cyclictest39-21ksoftirqd/220:19:382
2171399604,40cyclictest352-21runrttasks20:42:041
2172399542,41cyclictest19764-21taskset22:36:593
2172399542,41cyclictest19764-21taskset22:36:593
2172399534,38cyclictest28443-21taskset20:58:493
2172399523,39cyclictest7987-21taskset00:07:493
2172399523,38cyclictest14963-21taskset20:18:473
2172399522,37cyclictest12569-21chrt20:13:163
144842520,7sleep30-21swapper/323:23:303
144842520,7sleep30-21swapper/323:23:303
2172399513,38cyclictest32262-21taskset22:58:283
2172399513,31cyclictest21812-21taskset19:03:183
2172399512,39cyclictest29421-21taskset23:48:353
2172399504,35cyclictest26011-21taskset23:43:163
2172399503,37cyclictest25558-21taskset22:46:483
2172399503,37cyclictest16015-21taskset22:29:373
2172399503,35cyclictest5730-21chrt21:18:313
2172399503,34cyclictest2907-21chrt23:58:363
2172399503,34cyclictest27400-21taskset20:58:173
2172399503,34cyclictest22624-21chrt20:43:173
2172399503,34cyclictest20525-21chrt00:28:373
2172399502,37cyclictest29656-21taskset22:53:383
2172399494,34cyclictest11761-21chrt23:18:353
2172399493,36cyclictest29421-21chrt21:03:353
2172399493,36cyclictest16253-21taskset00:21:033
2172399492,37cyclictest7783-21chrt23:11:543
2172399492,37cyclictest7783-21chrt23:11:543
2172399484,35cyclictest4548-21chrt23:06:023
2172399483,35cyclictest32665-21chrt22:03:403
2172399483,35cyclictest32665-21chrt22:03:403
2172399483,35cyclictest23593-21chrt21:48:353
2172399483,35cyclictest12952-21chrt21:29:463
2172399483,35cyclictest11705-21taskset00:13:333
2172399483,35cyclictest11705-21taskset00:13:333
2172399483,34cyclictest22668-21taskset20:43:253
2172399483,34cyclictest10562-21chrt23:16:243
2172399483,34cyclictest10562-21chrt23:16:243
2172399483,33cyclictest20395-21taskset21:43:243
2172399483,33cyclictest20395-21taskset21:43:243
2172399483,33cyclictest10236-21chrt00:10:493
2172399483,33cyclictest10236-21chrt00:10:493
2172399482,35cyclictest8579-21chrt21:23:263
2172399482,35cyclictest8579-21chrt21:23:263
2172399474,33cyclictest24811-21taskset20:48:453
2172399473,35cyclictest32216-21chrt19:33:363
2172399473,35cyclictest32216-21chrt19:33:363
2172399473,34cyclictest4273-21taskset21:15:153
2172399473,34cyclictest4273-21taskset21:15:153
2172399473,34cyclictest22672-21chrt22:41:543
2172399473,34cyclictest16353-21chrt20:23:413
2172399473,34cyclictest15191-21chrt21:33:483
2172399473,33cyclictest9483-21taskset22:18:473
2172399473,33cyclictest21042-21chrt23:33:473
2172399473,32cyclictest26659-21chrt22:48:353
2172399472,35cyclictest19326-21taskset21:41:053
2172399472,34cyclictest28817-21chrt19:23:313
2172399472,34cyclictest18095-21chrt20:28:433
2172399472,34cyclictest17332-21taskset00:23:263
2172399472,34cyclictest13449-21chrt20:13:493
2172399463,34cyclictest26341-21chrt19:13:473
2172399463,33cyclictest5846-21chrt19:53:163
2172399463,33cyclictest17672-21chrt23:28:363
2172399462,35cyclictest5952-21chrt22:13:253
2172399462,35cyclictest5952-21chrt22:13:253
2172399462,35cyclictest5211-21chrt22:12:483
2172399462,35cyclictest5211-21chrt22:12:483
2172399462,34cyclictest32670-21chrt21:08:423
2172399462,34cyclictest30976-21chrt22:00:363
2172399462,33cyclictest27428-21chrt23:44:173
2172399462,33cyclictest13371-21chrt22:25:283
2172399462,33cyclictest13371-21chrt22:25:283
2172399454,31cyclictest28222-21chrt21:56:103
2172399453,32cyclictest25043-21chrt19:10:273
2172399443,31cyclictest790-21chrt23:54:063
2172399443,30cyclictest31259-21taskset19:28:503
2172399443,30cyclictest31259-21taskset19:28:503
2172399443,29cyclictest20115-21chrt20:33:503
2172399442,33cyclictest7721-21taskset19:58:313
2172399442,33cyclictest7721-21taskset19:58:313
2172399442,30cyclictest27692-21chrt19:18:413
2172399434,29cyclictest22399-21chrt19:03:433
2172399432,32cyclictest10659-21chrt20:08:153
2172399432,31cyclictest1454-21chrt19:38:383
2172399423,28cyclictest6299-21taskset19:53:373
2172399413,28cyclictest3831-21taskset19:44:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional