You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 10:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 02, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
169149910648,28cyclictest16900-21cyclictest21:50:391
15605210513,57sleep015643-21fschecks_count18:53:190
15605210513,57sleep015643-21fschecks_count18:53:190
1291021020,6sleep10-21swapper/100:14:321
169099910122,48cyclictest0-21swapper/021:58:130
16909999663,26cyclictest297-21systemd-logind21:17:540
277862950,10sleep2371rcuc/221:57:562
16914999546,12cyclictest16900-21cyclictest21:35:181
16914999546,12cyclictest16900-21cyclictest21:35:181
1690999949,43cyclictest20956-21timerandwakeup23:33:290
16909999414,36cyclictest13543-21apt-get23:23:050
16926999260,7cyclictest181rcu_preempt19:53:092
16914999175,10cyclictest1914-21/usr/sbin/munin23:03:091
16914999175,10cyclictest1914-21/usr/sbin/munin23:03:091
16914999163,9cyclictest181rcu_preempt23:48:481
16914999157,13cyclictest181rcu_preempt20:18:271
16926999055,8cyclictest181rcu_preempt22:23:362
16926999055,8cyclictest181rcu_preempt22:23:362
16909999023,35cyclictest0-21swapper/000:02:550
16926998968,15cyclictest20228-21threads20:43:292
16926998967,12cyclictest12636-21kworker/u17:4-rpciod21:37:562
16926998967,12cyclictest12636-21kworker/u17:4-rpciod21:37:562
16926998952,8cyclictest181rcu_preempt22:28:142
16909998969,11cyclictest24071-21diskmemload21:53:290
16926998861,18cyclictest22526-21sh22:43:152
16914998817,40cyclictest31-21ksoftirqd/119:57:571
16909998810,24cyclictest13491-21sed20:24:230
16926998755,8cyclictest181rcu_preempt23:20:402
16926998740,11cyclictest4141-21fschecks_count21:18:162
16926998740,11cyclictest4141-21fschecks_count21:18:162
16926998737,28cyclictest16900-21cyclictest22:09:102
16926998726,24cyclictest0-21swapper/223:15:122
1692699872,58cyclictest352-21runrttasks19:18:142
1692699872,58cyclictest352-21runrttasks19:18:142
16914998710,59cyclictest23734-21apt-get19:18:161
16914998710,59cyclictest23734-21apt-get19:18:161
16909998717,20cyclictest13902-21ssh00:17:250
16926998651,12cyclictest181rcu_preempt00:09:132
16926998651,12cyclictest181rcu_preempt00:09:132
1691499869,44cyclictest31-21ksoftirqd/122:08:411
16909998622,34cyclictest0-21swapper/020:59:280
16926998555,10cyclictest181rcu_preempt22:42:252
16926998549,13cyclictest181rcu_preempt20:48:312
16926998549,13cyclictest181rcu_preempt20:48:312
16914998567,12cyclictest0-21swapper/122:58:151
1691499852,54cyclictest14201-21ssh23:23:221
16909998565,12cyclictest277-21dbus-daemon22:52:540
16909998528,26cyclictest277-21dbus-daemon21:52:540
16909998521,33cyclictest0-21swapper/022:38:130
16926998452,10cyclictest181rcu_preempt22:14:182
16926998445,8cyclictest181rcu_preempt21:45:162
16926998428,20cyclictest0-21swapper/221:24:542
16926998425,26cyclictest0-21swapper/221:48:472
16914998450,8cyclictest181rcu_preempt22:24:561
16914998450,8cyclictest181rcu_preempt22:24:561
16914998448,30cyclictest4050-21apt-get22:13:121
16914998421,39cyclictest31-21ksoftirqd/119:38:221
16909998427,28cyclictest28133-21kworker/u17:3+xprtiod22:09:550
16909998422,30cyclictest8735-21kworker/u17:0+rpciod00:26:400
16909998422,30cyclictest8735-21kworker/u17:0+rpciod00:26:400
16909998421,23cyclictest0-21swapper/019:33:090
16909998419,28cyclictest14465-21rm21:34:480
16909998419,28cyclictest14465-21rm21:34:480
16926998353,10cyclictest181rcu_preempt22:06:502
16926998260,8cyclictest181rcu_preempt22:33:262
16926998260,8cyclictest181rcu_preempt22:33:262
16926998255,9cyclictest181rcu_preempt21:11:082
16926998231,22cyclictest0-21swapper/223:54:402
16914998261,8cyclictest181rcu_preempt22:06:021
16914998253,7cyclictest181rcu_preempt21:40:541
16914998251,8cyclictest181rcu_preempt20:38:291
1690999828,25cyclictest22623-21if_eth022:43:160
1690999826,45cyclictest5817-21ssh22:13:530
16909998261,13cyclictest5242-21fschecks_time23:08:170
16909998215,31cyclictest11225-21grep22:23:270
16909998215,31cyclictest11225-21grep22:23:270
16909998215,26cyclictest10989-21unixbench_singl21:28:320
16926998160,7cyclictest181rcu_preempt20:53:142
16926998156,17cyclictest24399-21kworker/u17:3-xprtiod23:03:132
16926998156,17cyclictest24399-21kworker/u17:3-xprtiod23:03:132
16926998151,7cyclictest181rcu_preempt20:08:232
16926998147,11cyclictest181rcu_preempt23:38:252
16926998147,11cyclictest181rcu_preempt23:38:252
16926998146,8cyclictest181rcu_preempt19:43:292
1692699813,49cyclictest13007-21apt-get20:23:112
16926998123,24cyclictest0-21swapper/223:27:202
1691499816,43cyclictest31-21ksoftirqd/121:43:181
16914998149,8cyclictest181rcu_preempt20:48:271
16914998149,8cyclictest181rcu_preempt20:48:271
1691499813,56cyclictest32259-21sh23:53:121
16914998135,11cyclictest181rcu_preempt21:32:491
16914998119,32cyclictest31-21ksoftirqd/123:58:301
16909998127,43cyclictest0-21swapper/023:38:030
16909998127,43cyclictest0-21swapper/023:38:030
16909998121,27cyclictest16556-21/usr/sbin/munin21:38:270
16909998119,23cyclictest9421-21ssh22:20:430
16909998113,27cyclictest28490-21vmstat21:03:340
16909998110,40cyclictest27919-21rm23:45:500
16926998059,16cyclictest16900-21cyclictest20:38:152
16926998056,17cyclictest544-21cron23:32:532
16926998056,17cyclictest544-21cron23:32:532
16926998046,10cyclictest181rcu_preempt23:58:192
16926998044,10cyclictest22292-21latency_hist19:12:572
1692699802,54cyclictest28954-21sh23:47:582
16914998054,8cyclictest181rcu_preempt20:23:541
16914998040,10cyclictest181rcu_preempt21:19:591
16914998040,10cyclictest181rcu_preempt21:19:591
16914998036,11cyclictest28505-21kworker/u19:1-rpciod21:27:541
1690999808,24cyclictest9538-21/usr/sbin/munin20:13:180
16909998024,21cyclictest30693-21apt-get19:38:050
16909998017,29cyclictest8090-21/usr/sbin/munin23:13:110
16909998010,22cyclictest0-21swapper/000:18:210
16926997954,16cyclictest27480-21apt-get19:28:082
16926997938,10cyclictest181rcu_preempt21:28:112
16926997927,21cyclictest0-21swapper/222:58:342
16914997958,8cyclictest181rcu_preempt21:08:481
16914997951,8cyclictest181rcu_preempt23:43:211
16914997935,11cyclictest181rcu_preempt19:13:281
16914997932,17cyclictest181rcu_preempt20:17:021
16909997919,22cyclictest349-21ssh22:59:190
16909997918,24cyclictest8504-21ssh00:08:060
16909997918,24cyclictest8504-21ssh00:08:060
16909997916,30cyclictest9678-21latency_hist21:27:560
16909997911,29cyclictest2464-21date23:57:570
155022799,37sleep20-21swapper/218:53:122
155022799,37sleep20-21swapper/218:53:122
1693099782,60cyclictest28528-21chrt22:53:163
16926997849,13cyclictest181rcu_preempt22:52:102
16926997847,9cyclictest181rcu_preempt21:16:152
16926997846,12cyclictest181rcu_preempt23:47:402
16926997844,11cyclictest181rcu_preempt22:21:362
16926997842,13cyclictest181rcu_preempt20:28:212
16926997837,17cyclictest181rcu_preempt19:23:232
16926997824,31cyclictest0-21swapper/221:39:312
1691499789,34cyclictest31-21ksoftirqd/123:41:011
1691499789,34cyclictest31-21ksoftirqd/123:41:011
16914997855,8cyclictest181rcu_preempt20:37:071
16914997855,8cyclictest181rcu_preempt20:37:071
16914997822,13cyclictest181rcu_preempt22:50:521
1690999788,40cyclictest6852-21open_files20:03:260
1690999783,40cyclictest0-21swapper/023:05:590
1690999783,40cyclictest0-21swapper/023:05:590
16909997821,20cyclictest17682-21grep18:58:260
16909997820,26cyclictest0-21swapper/019:48:110
16909997815,24cyclictest16988-21/usr/sbin/munin22:33:260
16909997815,24cyclictest16988-21/usr/sbin/munin22:33:260
16909997813,26cyclictest7930-21/usr/sbin/munin20:08:180
16909997810,37cyclictest22263-21cut19:12:570
16909997810,31cyclictest4027-21/usr/sbin/munin21:18:110
16909997810,31cyclictest4027-21/usr/sbin/munin21:18:110
16909997810,22cyclictest32288-21chrt22:04:270
1693099773,44cyclictest13786-21chrt22:28:153
16926997739,11cyclictest181rcu_preempt18:58:152
16926997737,12cyclictest181rcu_preempt20:18:242
16914997754,16cyclictest16900-21cyclictest22:18:291
1691499774,27cyclictest31-21ksoftirqd/100:08:081
1691499774,27cyclictest31-21ksoftirqd/100:08:081
16914997714,40cyclictest31-21ksoftirqd/120:53:261
16914997712,40cyclictest31-21ksoftirqd/120:46:511
16909997722,21cyclictest22372-21/usr/sbin/munin19:13:230
16909997717,21cyclictest6884-21ssh00:04:160
16909997716,24cyclictest5270-21/usr/sbin/munin19:58:250
16909997714,25cyclictest440-21uname19:43:260
16909997713,26cyclictest15236-21taskset22:30:390
16909997713,25cyclictest17604-21/usr/sbin/munin23:28:200
16909997713,25cyclictest17604-21/usr/sbin/munin23:28:200
69462760,12sleep3451rcuc/323:11:043
16926997649,13cyclictest18457-21ssh00:23:342
16926997649,13cyclictest18457-21ssh00:23:342
16926997647,8cyclictest181rcu_preempt00:19:052
16926997645,9cyclictest181rcu_preempt21:59:132
16926997644,13cyclictest181rcu_preempt21:05:012
16926997643,8cyclictest181rcu_preempt19:58:102
16926997638,9cyclictest181rcu_preempt00:05:422
16926997628,30cyclictest0-21swapper/219:07:562
16914997654,9cyclictest181rcu_preempt21:04:371
16914997640,21cyclictest1-21systemd21:17:541
16914997637,8cyclictest181rcu_preempt23:33:271
16914997637,11cyclictest5488-21/usr/sbin/munin00:03:101
16914997631,27cyclictest5369-21irqstats23:08:201
1691499762,55cyclictest32217-21kworker/u17:2+ext4-rsv-conversion22:53:161
16914997625,13cyclictest0-21swapper/122:30:361
1691499762,37cyclictest1226-21sendmail-msp19:47:531
1690999765,28cyclictest0-21swapper/019:28:210
16909997626,39cyclictest25641-21cat19:22:560
16909997626,39cyclictest25641-21cat19:22:560
1690999762,49cyclictest0-21swapper/023:18:180
16909997617,27cyclictest12080-21grep20:18:300
16909997615,29cyclictest28984-21/usr/sbin/munin23:48:280
16909997615,25cyclictest29027-21if_eth022:53:500
16909997614,24cyclictest17105-21sed20:33:300
16909997614,24cyclictest17105-21sed20:33:300
16909997613,25cyclictest15260-21sendmail_mailqu20:28:270
16909997610,28cyclictest0-21swapper/020:48:250
16909997610,28cyclictest0-21swapper/020:48:250
16926997560,8cyclictest0-21swapper/219:48:162
16926997560,10cyclictest19676-21snmpd23:09:072
16926997555,7cyclictest181rcu_preempt22:56:042
16926997547,7cyclictest181rcu_preempt23:34:182
16926997532,7cyclictest181rcu_preempt19:33:282
16926997529,11cyclictest0-21swapper/219:38:202
16914997556,12cyclictest27095-21systemd-run21:02:561
16914997553,8cyclictest181rcu_preempt22:38:341
16914997535,7cyclictest181rcu_preempt23:18:241
1691499752,29cyclictest20037-21ssh00:27:541
1691499752,29cyclictest20037-21ssh00:27:541
16909997533,28cyclictest22721-21apt-get20:53:040
16909997516,23cyclictest18839-21ssh21:42:590
16909997514,29cyclictest20591-21sed19:07:560
16909997513,29cyclictest17846-21/usr/sbin/munin20:38:290
16909997513,24cyclictest27432-21taskset19:27:570
16909997512,28cyclictest3621-21taskset19:53:220
1682927513,38sleep116833-21munin-run18:57:561
1682927513,38sleep116833-21munin-run18:57:561
16926997446,20cyclictest23333-21unixbench_singl19:13:302
16914997449,8cyclictest181rcu_preempt19:09:571
16914997441,9cyclictest181rcu_preempt22:02:151
16914997441,11cyclictest58-21kcompactd023:31:231
16914997441,11cyclictest58-21kcompactd023:31:231
16914997425,19cyclictest0-21swapper/100:18:291
16914997422,20cyclictest0-21swapper/123:13:201
16914997412,28cyclictest31-21ksoftirqd/120:30:391
16909997415,29cyclictest31841-21runrttasks21:09:300
156022747,15sleep30-21swapper/318:53:173
156022747,15sleep30-21swapper/318:53:173
16926997338,17cyclictest181rcu_preempt00:16:272
16926997338,14cyclictest181rcu_preempt20:59:232
16914997359,9cyclictest27191-21sendmail19:27:531
16914997339,8cyclictest181rcu_preempt19:48:211
1690999739,21cyclictest19676-21snmpd20:43:140
16926997250,8cyclictest181rcu_preempt20:07:562
16914997251,14cyclictest6103-21latency_hist20:02:561
16914997225,12cyclictest181rcu_preempt19:33:301
16926997153,13cyclictest10378-21timerwakeupswit20:13:292
16914997139,10cyclictest181rcu_preempt22:33:251
16914997139,10cyclictest181rcu_preempt22:33:251
16914997138,7cyclictest181rcu_preempt20:08:281
16914997131,10cyclictest181rcu_preempt19:03:121
16914997041,8cyclictest181rcu_preempt20:06:151
16914997031,9cyclictest0-21swapper/121:53:161
16926996934,16cyclictest58-21kcompactd020:34:562
16926996934,16cyclictest58-21kcompactd020:34:562
16914996940,8cyclictest181rcu_preempt22:44:451
16914996918,23cyclictest31-21ksoftirqd/118:58:281
16914996833,8cyclictest181rcu_preempt19:29:261
93592670,5sleep30-21swapper/320:12:563
292812620,3sleep3451rcuc/321:05:473
1693099583,40cyclictest21628-21chrt21:47:563
16930995813,26cyclictest0-21swapper/319:18:143
16930995813,26cyclictest0-21swapper/319:18:143
1693099574,40cyclictest28597-21taskset23:47:453
1693099563,41cyclictest32671-21taskset23:54:193
1693099563,38cyclictest13694-21taskset21:33:283
1693099563,38cyclictest13694-21taskset21:33:283
1693099553,38cyclictest21949-21chrt21:48:083
1693099553,36cyclictest4440-21chrt22:12:583
1693099553,34cyclictest13652-21taskset22:27:583
1693099533,40cyclictest8717-21taskset22:18:423
1693099533,39cyclictest22565-21chrt22:43:153
1693099533,33cyclictest27921-21chrt21:57:573
1693099522,37cyclictest3754-21taskset23:58:453
1693099522,37cyclictest15734-21taskset23:25:033
1693099513,37cyclictest5335-21chrt21:19:253
1693099513,37cyclictest5335-21chrt21:19:253
1693099513,36cyclictest29730-21chrt23:48:273
1693099513,35cyclictest21554-21chrt20:48:203
1693099513,35cyclictest21554-21chrt20:48:203
1693099512,37cyclictest2596-21taskset21:15:083
1693099512,35cyclictest32062-21taskset22:58:273
1693099503,36cyclictest9211-21chrt23:14:043
1693099503,33cyclictest1951-21chrt23:03:053
1693099503,33cyclictest1951-21chrt23:03:053
1693099503,32cyclictest9021-21chrt21:26:233
1693099493,35cyclictest21806-21chrt23:35:213
1693099493,35cyclictest18507-21chrt19:02:563
1693099493,34cyclictest6339-21taskset22:15:213
1693099493,34cyclictest11600-21chrt23:18:263
1693099493,30cyclictest27684-21chrt19:28:163
1693099492,38cyclictest12949-21taskset22:27:213
1693099492,36cyclictest27709-21chrt22:52:233
1693099492,33cyclictest18887-21chrt00:24:483
1693099492,33cyclictest18887-21chrt00:24:483
1693099483,34cyclictest10873-21chrt00:12:113
1693099483,34cyclictest10873-21chrt00:12:113
1693099483,33cyclictest11273-21chrt20:18:103
1693099483,32cyclictest31420-21chrt19:38:283
1693099483,29cyclictest0-21swapper/320:23:173
1693099473,35cyclictest24938-21taskset23:40:483
1693099473,35cyclictest24938-21taskset23:40:483
1693099473,34cyclictest18582-21chrt21:42:533
1693099473,34cyclictest15008-21chrt00:18:243
1693099473,34cyclictest10277-21chrt21:28:173
1693099473,32cyclictest19893-21chrt22:38:243
1693099473,30cyclictest24201-21chrt20:57:563
1693099472,33cyclictest12944-21taskset00:14:393
1693099472,31cyclictest16691-21chrt22:33:173
1693099472,31cyclictest16691-21chrt22:33:173
16930994712,24cyclictest7694-21chrt20:07:533
1693099464,29cyclictest31729-21taskset22:03:293
16930994627,12cyclictest0-21swapper/300:07:533
1693099462,32cyclictest17712-21taskset23:28:233
1693099462,32cyclictest17712-21taskset23:28:233
1693099453,32cyclictest26741-21taskset21:02:023
1693099452,31cyclictest14733-21taskset20:28:113
1693099443,28cyclictest4600-21taskset19:57:573
1693099434,29cyclictest26317-21chrt19:23:213
1693099433,29cyclictest28951-21taskset21:59:363
1693099433,27cyclictest29931-21chrt19:33:303
1693099433,27cyclictest24198-21taskset19:17:583
1693099423,28cyclictest18784-21taskset19:03:003
1693099422,30cyclictest18968-21chrt20:39:583
1693099413,28cyclictest32316-21taskset21:10:503
1693099413,28cyclictest19484-21chrt20:43:103
1693099413,26cyclictest9700-21taskset20:13:123
1693099413,22cyclictest1754-21chrt19:48:173
1693099403,28cyclictest22196-21chrt19:12:563
1693099403,27cyclictest17370-21taskset20:35:083
1693099403,27cyclictest17370-21taskset20:35:083
1693099393,27cyclictest4703-21taskset19:58:053
1693099392,25cyclictest1364-21taskset19:47:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional