You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 06:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Mar 27, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
84621169,74sleep2887-21/usr/sbin/munin19:01:002
15639911539,68cyclictest0-21swapper/021:54:510
15639910521,51cyclictest0-21swapper/021:19:490
15639910521,51cyclictest0-21swapper/021:19:490
15639910421,59cyclictest0-21swapper/000:06:120
15639910333,42cyclictest10436-21ssh23:58:140
15639910245,50cyclictest24315-21ssh23:27:210
15639910245,50cyclictest24315-21ssh23:27:210
1563991022,66cyclictest12602-21seq22:14:340
15639910221,58cyclictest0-21swapper/000:04:160
1563991013,84cyclictest0-21swapper/023:04:360
1563991013,84cyclictest0-21swapper/023:04:360
1563999920,58cyclictest0-21swapper/022:13:480
1563999920,58cyclictest0-21swapper/022:13:480
1563999811,78cyclictest2952-21systemd-journal21:34:400
1563999811,78cyclictest2952-21systemd-journal21:34:400
1563999744,47cyclictest23926-21cstates21:29:420
1563999744,47cyclictest23926-21cstates21:29:420
1563999744,47cyclictest23926-21cstates21:29:420
1563999628,51cyclictest0-21swapper/023:19:540
1563999628,51cyclictest0-21swapper/023:19:540
1563999611,56cyclictest29457-21kworker/u17:3+rpciod22:43:180
1569999549,39cyclictest4133-21systemd-run22:54:261
1563999546,42cyclictest339-21sh23:40:550
1563999543,45cyclictest0-21swapper/022:35:350
1563999537,50cyclictest0-21swapper/019:24:250
1569999451,35cyclictest0-21swapper/123:24:261
1569999451,35cyclictest0-21swapper/123:24:261
156999944,78cyclictest0-21swapper/119:54:401
1563999443,45cyclictest31958-21latency20:35:450
1563999443,45cyclictest31958-21latency20:35:450
156399933,83cyclictest0-21swapper/019:54:400
156399933,78cyclictest18110-21ssh23:16:410
156399933,78cyclictest0-21swapper/023:44:380
1563999336,46cyclictest0-21swapper/022:54:280
156399933,54cyclictest7228-21seq23:52:450
1563999326,58cyclictest0-21swapper/022:29:430
1563999311,60cyclictest0-21swapper/022:46:060
3275929216,39sleep10-21swapper/119:00:391
156999923,8cyclictest0-21swapper/121:09:391
1563999240,44cyclictest352-21runrttasks21:14:420
1563999229,51cyclictest161ktimers/019:04:380
1563999227,55cyclictest0-21swapper/021:24:310
156399922,60cyclictest352-21runrttasks00:28:450
156399913,81cyclictest18628-21apt-get22:24:370
1563999134,50cyclictest0-21swapper/021:07:400
156999903,80cyclictest0-21swapper/120:14:421
156999903,49cyclictest26277-21apt-get00:24:381
1563999036,47cyclictest0-21swapper/020:10:030
1563999036,44cyclictest0-21swapper/020:44:430
1563999036,44cyclictest0-21swapper/020:44:430
1563999026,58cyclictest16080-21sh23:14:250
156399902,54cyclictest27292-21seq23:32:180
1569998946,36cyclictest13868-21latency23:09:511
1563998941,44cyclictest1553-21cyclictest19:10:030
1563998941,44cyclictest1553-21cyclictest19:10:030
1563998937,46cyclictest20152-21fschecks_count19:59:500
1563998937,46cyclictest20152-21fschecks_count19:59:500
1563998937,44cyclictest0-21swapper/019:35:010
1563998933,50cyclictest18029-21sh00:10:010
1563998933,49cyclictest0-21swapper/022:59:510
156399892,56cyclictest9861-21seq19:28:010
1569998850,32cyclictest31699-21fschecks_time23:39:471
1569998850,31cyclictest24967-21kworker/u17:1-xprtiod23:45:311
156999883,8cyclictest0-21swapper/122:14:441
156399883,49cyclictest0-21swapper/023:35:410
1563998824,58cyclictest0-21swapper/000:29:410
1563998824,58cyclictest0-21swapper/000:29:410
156999873,7cyclictest0-21swapper/119:09:401
156999873,7cyclictest0-21swapper/119:09:401
156399874,74cyclictest26403-21apt-get20:19:380
156399873,80cyclictest0-21swapper/019:44:370
156399873,77cyclictest22931-21find00:19:260
156999863,34cyclictest5482-21/usr/sbin/munin20:54:511
156999862,6cyclictest0-21swapper/119:59:441
156999862,6cyclictest0-21swapper/119:59:441
156399862,76cyclictest0-21swapper/020:04:400
156399862,76cyclictest0-21swapper/020:04:400
156399862,55cyclictest9078-21seq22:06:110
1563998623,55cyclictest0-21swapper/022:19:440
158499853,52cyclictest0-21swapper/322:34:453
1569998533,44cyclictest0-21swapper/123:29:401
156399854,75cyclictest28833-21kworker/u17:2+rpciod21:54:270
156399854,68cyclictest642-21apt-get20:39:380
156399854,68cyclictest642-21apt-get20:39:380
156399853,75cyclictest0-21swapper/020:24:380
1563998532,47cyclictest24011-21ssh00:21:110
1563998527,51cyclictest0-21swapper/020:59:460
1563998527,51cyclictest0-21swapper/020:59:460
156399852,73cyclictest11802-21ssh21:09:390
157799844,38cyclictest39-21ksoftirqd/222:22:352
156999844,7cyclictest0-21swapper/119:44:371
156999843,70cyclictest28409-21ssh23:34:361
156999842,39cyclictest7892-40mandb23:54:271
156999842,38cyclictest20834-21ssh21:24:401
156999842,35cyclictest23108-21/usr/sbin/munin23:24:591
156999842,35cyclictest23108-21/usr/sbin/munin23:24:591
156399842,73cyclictest31769-21wc21:44:290
156999834,7cyclictest0-21swapper/121:19:361
156999834,7cyclictest0-21swapper/121:19:361
156999833,8cyclictest0-21swapper/120:35:321
156999833,8cyclictest0-21swapper/120:35:321
156999833,36cyclictest14848-21seq21:14:411
156999832,38cyclictest9509-21/usr/sbin/munin21:04:581
156999832,37cyclictest25966-21awk00:24:251
156999832,37cyclictest10166-21cat23:04:271
156999832,36cyclictest23809-21runrttasks21:29:371
156999832,36cyclictest23809-21runrttasks21:29:371
156999832,36cyclictest23809-21runrttasks21:29:371
156999832,35cyclictest10873-21/usr/sbin/munin19:29:591
156399833,75cyclictest0-21swapper/019:04:300
156399833,70cyclictest4542-21/usr/sbin/munin22:54:420
156399833,68cyclictest5426-21apt-get19:14:350
1563998331,45cyclictest0-21swapper/022:02:400
1563998331,45cyclictest0-21swapper/022:02:400
156399832,54cyclictest0-21swapper/021:46:060
156399832,52cyclictest25831-21seq20:15:390
1577998245,23cyclictest0-21swapper/223:50:102
156999824,6cyclictest0-21swapper/120:24:381
156999824,35cyclictest28696-21rm21:37:111
156999824,35cyclictest28696-21rm21:37:111
156999823,36cyclictest3930-21sort20:49:421
156999823,34cyclictest25768-21sendmail_mailqu22:35:291
1569998229,45cyclictest0-21swapper/123:05:031
1569998229,45cyclictest0-21swapper/123:05:031
156999822,37cyclictest30026-21ssh22:43:021
156399823,75cyclictest0-21swapper/019:29:380
156999814,72cyclictest0-21swapper/119:14:381
156999813,73cyclictest0-21swapper/100:14:411
156999813,36cyclictest8814-21/usr/sbin/munin19:24:471
156999813,35cyclictest23319-21/usr/sbin/munin20:09:471
156999813,34cyclictest30957-21latency_hist20:34:291
156999813,30cyclictest3223-21modprobe21:54:261
156999812,8cyclictest0-21swapper/100:04:401
1569998128,43cyclictest0-21swapper/121:04:291
1569998128,43cyclictest0-21swapper/121:04:291
156999812,35cyclictest13241-21modprobe19:39:261
156399812,71cyclictest0-21swapper/019:49:350
1577998057,16cyclictest544-21cron20:24:252
1577998032,9cyclictest0-21swapper/200:00:052
156999804,62cyclictest0-21swapper/122:19:421
156999803,36cyclictest19124-21seq23:19:251
156999803,36cyclictest17960-21runrttasks00:10:011
156999803,35cyclictest26689-21/usr/sbin/munin20:19:491
156999803,34cyclictest11221-21ssh23:59:411
156999803,28cyclictest29213-21/usr/sbin/munin00:29:531
156999803,28cyclictest29213-21/usr/sbin/munin00:29:531
156999803,25cyclictest3486-21/usr/sbin/munin21:54:571
156999802,6cyclictest0-21swapper/123:54:411
156999802,38cyclictest3762-21grep20:49:281
156999802,38cyclictest3762-21grep20:49:281
156999802,36cyclictest18743-21awk22:24:431
156999802,35cyclictest8258-21systemctl22:04:271
156999802,35cyclictest8258-21systemctl22:04:271
156399803,63cyclictest31402-21cat20:34:300
1577997963,11cyclictest1553-21cyclictest20:09:562
156999793,63cyclictest0-21swapper/119:49:361
156999793,35cyclictest4599-21df_inode22:54:441
156999793,35cyclictest30872-21ssh22:44:401
156999792,72cyclictest0-21swapper/120:04:401
156999792,72cyclictest0-21swapper/120:04:401
156999792,36cyclictest22139-21ssh22:29:541
156999792,25cyclictest14171-21/usr/sbin/munin19:39:591
156399792,70cyclictest14689-21chrt19:42:470
157799785,62cyclictest25054-21ssh22:35:072
157799783,50cyclictest30954-21apt-get20:34:422
157799783,50cyclictest30954-21apt-get20:34:422
1577997830,10cyclictest181rcu_preempt22:42:432
156999783,36cyclictest7320-21/usr/sbin/munin19:19:471
1569997829,41cyclictest0-21swapper/119:04:471
156999782,35cyclictest31590-21munin-run21:44:261
1577997758,13cyclictest31259-21apt-key20:34:302
1577997752,16cyclictest2637-21unixbench_multi19:05:022
156999772,34cyclictest352-21runrttasks22:10:531
156999772,34cyclictest352-21runrttasks22:10:531
1563997730,41cyclictest0-21swapper/020:50:020
157799764,46cyclictest8469-21diskmemload23:04:582
157799764,46cyclictest8469-21diskmemload23:04:582
157799763,26cyclictest39-21ksoftirqd/200:13:362
156999764,33cyclictest9335-21ssh22:06:531
156999762,30cyclictest1077-21ssh21:49:191
1577997551,14cyclictest0-21swapper/200:30:022
1577997551,14cyclictest0-21swapper/200:30:022
1577997550,18cyclictest22396-21acpi23:24:362
1577997550,18cyclictest22396-21acpi23:24:362
157799752,29cyclictest39-21ksoftirqd/219:13:032
157799752,29cyclictest39-21ksoftirqd/219:13:032
156999753,24cyclictest1631-21/usr/sbin/munin20:40:031
156999753,24cyclictest1631-21/usr/sbin/munin20:40:031
247332740,8sleep30-21swapper/300:21:263
1577997449,19cyclictest24295-21idleruntime-cro22:34:262
156399743,63cyclictest0-21swapper/020:54:360
1577997356,11cyclictest24967-21kworker/u17:1-rpciod23:43:582
157799733,50cyclictest1538-21tail20:40:032
157799733,50cyclictest1538-21tail20:40:032
157799726,55cyclictest23505-21sshd00:20:102
1577997149,15cyclictest2952-21systemd-journal22:07:402
1577997136,11cyclictest181rcu_preempt19:44:532
157799713,37cyclictest13754-21fschecks_time19:39:472
157799713,34cyclictest39-21ksoftirqd/221:07:442
1577997049,7cyclictest181rcu_preempt21:13:172
1577997036,28cyclictest17152-21mailstats23:14:582
157799703,33cyclictest8469-21diskmemload00:08:212
199022690,9sleep20-21swapper/219:59:302
157799694,33cyclictest39-21ksoftirqd/222:24:462
1577996938,10cyclictest181rcu_preempt23:47:042
157799693,47cyclictest803-21sendmail-mta21:41:292
157799692,41cyclictest39-21ksoftirqd/223:09:392
157799692,37cyclictest39-21ksoftirqd/222:10:132
157799692,37cyclictest39-21ksoftirqd/222:10:132
1577996921,25cyclictest39-21ksoftirqd/200:25:552
157799688,35cyclictest39-21ksoftirqd/223:38:212
1577996848,14cyclictest544-21cron23:24:262
1577996848,14cyclictest544-21cron23:24:262
1577996844,15cyclictest0-21swapper/221:52:402
157799684,31cyclictest39-21ksoftirqd/219:53:282
157799683,43cyclictest26051-21wc23:29:572
1577996832,7cyclictest181rcu_preempt23:58:012
1577996823,23cyclictest39-21ksoftirqd/220:49:332
157799682,30cyclictest39-21ksoftirqd/219:35:142
157799682,29cyclictest39-21ksoftirqd/220:15:192
1577996821,24cyclictest39-21ksoftirqd/222:00:382
1577996821,24cyclictest39-21ksoftirqd/222:00:382
157799678,12cyclictest39-21ksoftirqd/221:36:012
157799678,12cyclictest39-21ksoftirqd/221:36:012
1577996751,9cyclictest0-21swapper/221:20:002
1577996751,9cyclictest0-21swapper/221:20:002
1577996749,12cyclictest298-21in:imuxsock19:29:262
1577996749,10cyclictest0-21swapper/222:54:272
1577996746,14cyclictest21140-21fschecks_time21:24:482
1577996745,16cyclictest1337-21kworker/u17:3+events_unbound21:59:252
157799673,42cyclictest28370-21sed20:24:512
1577996649,11cyclictest14315-21ssh22:16:392
1577996644,15cyclictest298-21in:imuxsock20:49:252
1577996644,15cyclictest298-21in:imuxsock20:49:252
1577996635,10cyclictest181rcu_preempt19:59:572
1577996635,10cyclictest181rcu_preempt19:59:572
157799663,29cyclictest39-21ksoftirqd/221:45:532
157799662,33cyclictest39-21ksoftirqd/200:17:582
1577996548,12cyclictest1553-21cyclictest22:59:532
1577996546,13cyclictest1-21systemd21:33:142
1577996546,13cyclictest1-21systemd21:33:142
1577996546,13cyclictest1-21systemd21:33:142
158499649,35cyclictest0-21swapper/323:49:573
1577996448,10cyclictest297-21systemd-logind19:24:262
157799644,30cyclictest39-21ksoftirqd/220:55:162
1577996439,14cyclictest1062-21latency_hist22:49:282
1577996424,23cyclictest39-21ksoftirqd/219:14:472
1577996346,11cyclictest352-21runrttasks19:30:022
157799633,42cyclictest352-21runrttasks20:04:332
157799633,42cyclictest352-21runrttasks20:04:332
158499622,39cyclictest917-21kworker/3:1+events20:34:433
158499622,39cyclictest917-21kworker/3:1+events20:34:433
157799622,37cyclictest39-21ksoftirqd/222:57:032
1577996219,20cyclictest371rcuc/221:00:022
1577996219,20cyclictest371rcuc/221:00:022
41426112,29sleep30-21swapper/319:00:453
158499604,41cyclictest24347-21chrt22:34:263
158499603,38cyclictest26744-21chrt21:34:343
158499603,38cyclictest26744-21chrt21:34:343
158499603,38cyclictest26744-21chrt21:34:343
157799605,20cyclictest39-21ksoftirqd/221:18:022
158499585,36cyclictest917-21kworker/3:1+events21:12:263
158499574,38cyclictest22890-21chrt23:24:513
158499574,38cyclictest22890-21chrt23:24:513
158499574,37cyclictest18159-21chrt00:10:033
158499573,39cyclictest917-21kworker/3:1+events22:01:013
158499573,39cyclictest917-21kworker/3:1+events22:01:013
158499563,39cyclictest23318-21taskset21:28:593
158499554,36cyclictest4165-21chrt20:49:493
158499553,39cyclictest32203-21chrt23:39:593
158499545,33cyclictest8447-21chrt19:24:283
158499544,34cyclictest14812-21chrt21:14:363
158499543,38cyclictest4608-21chrt22:54:453
158499543,37cyclictest14798-21taskset22:18:013
158499543,37cyclictest1334-21chrt21:49:293
158499543,37cyclictest10196-21taskset22:09:183
158499542,35cyclictest31369-21chrt20:34:303
158499534,39cyclictest29105-21taskset21:38:193
158499534,39cyclictest29105-21taskset21:38:193
158499534,38cyclictest917-21kworker/3:1+events00:04:453
158499534,37cyclictest5444-21chrt19:14:403
158499534,34cyclictest27156-21chrt00:25:033
158499533,38cyclictest11883-21chrt19:34:363
158499533,34cyclictest11149-21chrt23:59:333
158499532,38cyclictest29386-21chrt20:29:273
158499532,35cyclictest27821-21taskset22:39:333
158499532,35cyclictest25324-21taskset23:29:293
158499532,34cyclictest13600-21taskset19:39:423
158499524,32cyclictest8297-21chrt23:54:423
158499523,40cyclictest917-21kworker/3:1+events23:24:283
158499523,40cyclictest917-21kworker/3:1+events23:24:283
158499523,38cyclictest22303-21chrt00:17:533
158499523,37cyclictest1003-21chrt22:49:183
158499523,35cyclictest10707-21chrt22:10:033
158499523,35cyclictest10707-21chrt22:10:033
158499517,33cyclictest4745-21chrt21:55:243
158499514,32cyclictest7014-21chrt20:59:283
158499514,31cyclictest24757-21chrt20:14:293
158499513,38cyclictest8028-21chrt22:59:563
158499513,36cyclictest32002-21chrt00:34:273
158499513,36cyclictest32002-21chrt00:34:273
158499513,35cyclictest16690-21chrt22:20:043
158499513,34cyclictest10584-21chrt19:29:503
158499504,30cyclictest4285-21chrt22:54:283
158499504,30cyclictest13385-21chrt23:09:363
158499503,33cyclictest25593-21taskset20:15:023
158499503,33cyclictest19402-21taskset21:21:253
158499503,33cyclictest19402-21taskset21:21:253
158499503,33cyclictest18183-21chrt19:54:283
158499503,32cyclictest3773-21chrt20:49:283
158499503,32cyclictest3773-21chrt20:49:283
158499502,36cyclictest10239-21taskset21:06:013
158499502,35cyclictest30071-21chrt23:36:393
158499502,33cyclictest3267-21chrt19:09:293
1584995012,23cyclictest0-21swapper/323:44:513
158499493,33cyclictest2024-21chrt20:44:263
158499493,33cyclictest2024-21chrt20:44:263
158499493,30cyclictest29839-21chrt21:39:403
158499492,36cyclictest21412-21chrt22:29:283
158499492,33cyclictest19354-21taskset19:55:263
1584994911,20cyclictest0-21swapper/323:14:363
158499484,32cyclictest917-21kworker/3:1+events20:04:423
158499484,32cyclictest917-21kworker/3:1+events20:04:423
158499483,36cyclictest2459-21chrt21:52:293
158499483,32cyclictest4182-21chrt19:09:543
158499483,32cyclictest4182-21chrt19:09:543
158499483,32cyclictest20398-21chrt19:59:553
158499483,32cyclictest20398-21chrt19:59:553
158499473,29cyclictest27093-21chrt20:20:003
158499463,35cyclictest11008-21taskset23:04:543
158499463,35cyclictest11008-21taskset23:04:543
158499463,34cyclictest8791-21chrt19:24:443
158499403,23cyclictest917-21kworker/3:1+events19:44:333
1584993911,15cyclictest0-21swapper/321:04:293
1584993911,15cyclictest0-21swapper/321:04:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional