You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 03:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jul 10, 2026 00:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1843022260,19sleep30-21swapper/318:53:043
192229911081,21cyclictest23398-21apt-key20:47:241
192299910848,43cyclictest11085-21ntpd23:47:532
1327821070,4sleep113250-21ssh23:17:201
192299910483,14cyclictest19230-21munin-plugin-st23:27:202
19229991033,85cyclictest4614-21apt-get23:02:342
19229999929,37cyclictest0-21swapper/200:23:282
19213999872,8cyclictest181rcu_preempt22:05:240
19213999872,8cyclictest181rcu_preempt22:05:240
19213999854,10cyclictest181rcu_preempt20:22:350
19213999854,10cyclictest181rcu_preempt20:22:350
19213999853,18cyclictest3909-21ssh23:55:000
182762989,63sleep118282-21/usr/sbin/munin18:52:591
1922999973,52cyclictest0-21swapper/223:12:242
1922999973,52cyclictest0-21swapper/223:12:242
19229999723,45cyclictest18576-21basename22:32:212
19229999522,43cyclictest19200-21cyclictest21:22:242
19229999220,42cyclictest7573-21timerandwakeup19:57:562
19229999220,42cyclictest7573-21timerandwakeup19:57:562
19229999166,17cyclictest10519-21sh00:06:492
1922999915,50cyclictest0-21swapper/222:22:422
19229999147,38cyclictest21805-21interrupts21:42:462
1922999903,53cyclictest352-21runrttasks23:38:242
1922999903,53cyclictest352-21runrttasks23:38:242
1922999903,50cyclictest352-21runrttasks19:47:442
1922999903,49cyclictest2374-21systemd-journal21:27:212
19229999029,31cyclictest0-21swapper/219:47:242
1922999902,52cyclictest28097-21apt-get22:47:322
19222999057,10cyclictest181rcu_preempt21:47:191
1922999893,50cyclictest0-21swapper/222:57:522
1922999893,47cyclictest0-21swapper/222:07:342
19222998963,19cyclictest13491-21apt-get20:17:321
19213998970,13cyclictest13358-21wc21:27:580
19213998860,11cyclictest181rcu_preempt20:43:170
19213998842,33cyclictest20864-21cat00:22:560
1922999872,51cyclictest3185-21unixbench_singl23:53:002
19222998770,13cyclictest19200-21cyclictest23:57:391
19222998770,11cyclictest10570-21fschecks_time20:08:401
19222998769,11cyclictest0-21swapper/121:37:451
19222998762,19cyclictest26202-21latency_hist19:17:241
19229998655,21cyclictest24687-21fschecks_time21:47:432
19213998631,11cyclictest181rcu_preempt22:57:230
180882867,54sleep218103-21kernelversion18:52:522
1922999854,51cyclictest0-21swapper/222:02:232
19229998541,33cyclictest0-21swapper/221:07:382
19222998563,16cyclictest23855-21fschecks_count20:47:551
19222998561,16cyclictest19555-21/usr/sbin/munin23:27:551
19222998556,20cyclictest21556-21apt-key20:42:241
19222998556,20cyclictest21556-21apt-key20:42:241
19213998540,8cyclictest181rcu_preempt19:07:240
19229998444,32cyclictest0-21swapper/223:17:232
1922999843,48cyclictest22739-21ssh23:32:402
19222998462,15cyclictest6256-21sh21:17:241
19222998459,18cyclictest6783-21latency_hist22:12:231
1922999834,64cyclictest18531-21grep20:32:412
1922999834,64cyclictest18531-21grep20:32:412
1922999833,49cyclictest19434-21netstat22:32:502
19213998362,15cyclictest19200-21cyclictest22:51:170
1922999823,69cyclictest21791-21apt-get20:42:342
1922999823,67cyclictest14208-21/usr/sbin/munin23:17:522
1922999823,67cyclictest14208-21/usr/sbin/munin23:17:522
1922999823,59cyclictest23663-21apt-get20:47:352
1922999822,45cyclictest26540-21seq20:56:372
1922999822,45cyclictest26540-21seq20:56:372
19222998263,14cyclictest19200-21cyclictest20:12:431
19213998260,16cyclictest6158-21idleruntime-cro21:17:200
19213998257,13cyclictest0-21swapper/021:07:560
19213998244,8cyclictest181rcu_preempt18:57:380
19213998244,8cyclictest181rcu_preempt18:57:380
19213998239,13cyclictest32126-21ssh21:59:480
19229998134,38cyclictest12175-21sort20:12:442
1922999812,72cyclictest9914-21ssh22:17:362
1922999812,72cyclictest9914-21ssh22:17:362
19229998124,25cyclictest0-21swapper/220:17:422
19222998161,14cyclictest8787-21ssh21:21:261
19222998159,16cyclictest19200-21cyclictest20:57:361
19222998159,16cyclictest0-21swapper/119:32:481
19222998155,10cyclictest181rcu_preempt23:32:321
19213998157,17cyclictest4997-21latency_hist19:52:230
19213998155,17cyclictest22191-21fschecks_time22:37:440
19213998138,8cyclictest181rcu_preempt23:18:240
19213998138,8cyclictest181rcu_preempt23:18:240
19213998136,11cyclictest181rcu_preempt23:12:460
19213998128,16cyclictest181rcu_preempt19:37:200
185002819,38sleep00-21swapper/018:53:060
1922999804,47cyclictest0-21swapper/222:37:562
19229998039,35cyclictest0-21swapper/221:27:572
1922999803,64cyclictest18636-21ssh00:19:222
1922999803,64cyclictest18636-21ssh00:19:222
19222998059,15cyclictest300-21rs:main1
19222998058,15cyclictest19200-21cyclictest19:02:401
1922299802,40cyclictest27530-21apt-get22:47:371
19213998039,8cyclictest181rcu_preempt23:42:240
19213998039,8cyclictest181rcu_preempt23:42:240
19213998028,24cyclictest181rcu_preempt21:32:570
1922999794,56cyclictest27935-21apt-get19:22:322
1922999794,56cyclictest27935-21apt-get19:22:322
1922999793,45cyclictest1470-21seq19:40:032
19229997930,43cyclictest0-21swapper/220:05:212
19229997930,43cyclictest0-21swapper/220:05:212
19222997961,11cyclictest22712-21sendmail00:27:201
19222997930,18cyclictest0-21swapper/123:24:161
19213997956,17cyclictest13958-21latency_hist00:12:240
19213997956,17cyclictest13958-21latency_hist00:12:240
19213997939,10cyclictest181rcu_preempt20:32:530
19213997939,10cyclictest181rcu_preempt20:32:530
19213997936,11cyclictest181rcu_preempt19:37:430
1922999783,64cyclictest0-21swapper/220:27:342
1922999783,64cyclictest0-21swapper/220:27:342
1922999783,45cyclictest0-21swapper/222:47:252
1922999783,38cyclictest16997-21ssh21:34:162
19229997833,39cyclictest0-21swapper/222:12:392
19229997833,39cyclictest0-21swapper/222:12:392
19229997819,39cyclictest0-21swapper/200:12:562
19222997849,11cyclictest181rcu_preempt22:57:041
19222997844,12cyclictest181rcu_preempt00:22:001
19222997844,12cyclictest181rcu_preempt00:22:001
19213997839,11cyclictest181rcu_preempt22:26:400
19213997832,11cyclictest181rcu_preempt22:28:260
19229997729,34cyclictest23379-21cut19:07:432
19222997762,10cyclictest297-21systemd-logind20:57:221
19222997762,10cyclictest297-21systemd-logind20:57:221
19222997758,11cyclictest14646-21ntp_kernel_pll_00:12:521
19222997757,12cyclictest0-21swapper/123:17:541
19222997757,12cyclictest0-21swapper/123:17:541
19222997755,16cyclictest15857-21timerandwakeup20:22:551
19222997755,16cyclictest15857-21timerandwakeup20:22:551
19222997740,12cyclictest14562-21ssh22:24:381
19222997736,18cyclictest0-21swapper/122:02:221
19222997727,25cyclictest0-21swapper/121:48:471
19213997741,12cyclictest181rcu_preempt23:27:590
19213997733,8cyclictest181rcu_preempt20:37:520
19213997733,8cyclictest181rcu_preempt20:37:520
19213997722,26cyclictest181rcu_preempt21:37:400
19213997718,39cyclictest11788-21rm22:20:140
19213997718,39cyclictest11788-21rm22:20:140
19229997631,38cyclictest0-21swapper/223:42:362
19229997629,40cyclictest0-21swapper/200:07:482
19229997629,40cyclictest0-21swapper/200:07:482
1922999762,47cyclictest20338-21seq21:40:162
19229997621,27cyclictest0-21swapper/221:12:532
19222997646,12cyclictest181rcu_preempt20:07:231
19222997646,12cyclictest181rcu_preempt20:07:231
19222997639,12cyclictest0-21swapper/123:48:441
1922299763,41cyclictest16907-21unixbench_multi22:27:581
19222997611,29cyclictest9094-21unixbench_singl00:02:581
1921399764,38cyclictest15-21ksoftirqd/022:57:340
19213997641,9cyclictest0-21swapper/020:02:230
19213997641,9cyclictest0-21swapper/020:02:230
19213997639,9cyclictest181rcu_preempt19:07:540
19213997635,9cyclictest181rcu_preempt21:47:570
19213997634,8cyclictest181rcu_preempt21:43:010
19213997624,21cyclictest0-21swapper/021:02:480
19213997618,23cyclictest0-21swapper/022:07:450
1922999753,63cyclictest31173-21apt-get19:32:322
19229997531,35cyclictest31325-21fschecks_count22:52:442
19222997552,14cyclictest0-21swapper/121:37:231
19222997546,20cyclictest5005-21latency_hist23:57:241
19213997554,15cyclictest16712-21sh00:17:200
19213997546,9cyclictest181rcu_preempt23:23:180
1921399754,39cyclictest10722-21munin-run00:07:210
19213997541,8cyclictest181rcu_preempt19:13:530
19213997541,7cyclictest181rcu_preempt20:52:360
19213997541,7cyclictest181rcu_preempt20:52:360
19213997537,8cyclictest181rcu_preempt22:33:430
19213997530,9cyclictest181rcu_preempt23:37:190
19213997529,14cyclictest181rcu_preempt20:57:310
19213997523,12cyclictest352-21runrttasks22:42:400
1922999743,54cyclictest30294-21latency_hist21:57:242
19229997431,34cyclictest0-21swapper/219:02:282
1922999742,44cyclictest5857-21runrttasks19:52:542
1922999742,44cyclictest5857-21runrttasks19:52:542
19229997411,54cyclictest9745-21apt-get20:07:352
19222997456,11cyclictest0-21swapper/119:22:551
19222997456,11cyclictest0-21swapper/119:22:551
19222997435,15cyclictest181rcu_preempt21:29:011
1922299743,35cyclictest25535-21sort23:37:321
1922299743,35cyclictest25535-21sort23:37:321
19222997422,13cyclictest181rcu_preempt21:52:421
19222997420,27cyclictest12555-21latency_hist22:22:201
19222997420,27cyclictest12555-21latency_hist22:22:201
1921399743,37cyclictest1909-21latency_hist23:52:240
1922999733,56cyclictest0-21swapper/218:57:382
1922999733,56cyclictest0-21swapper/218:57:382
19222997312,16cyclictest7305-21basename23:07:201
19213997349,16cyclictest9340-21ssh22:16:430
19213997349,16cyclictest9340-21ssh22:16:430
1922999729,54cyclictest0-21swapper/219:12:382
1922999727,57cyclictest0-21swapper/220:25:222
1922999727,57cyclictest0-21swapper/220:25:222
19229997249,17cyclictest3601-21idleruntime-cro22:07:212
19229997249,17cyclictest3601-21idleruntime-cro22:07:212
1922999723,63cyclictest0-21swapper/219:27:332
1922999723,63cyclictest0-21swapper/219:27:332
1922999723,55cyclictest5660-21/usr/sbin/munin23:57:502
1922999722,61cyclictest0-21swapper/223:27:342
19229997221,26cyclictest0-21swapper/220:59:382
19222997258,8cyclictest0-21swapper/122:32:501
19222997257,8cyclictest0-21swapper/121:24:511
19222997249,14cyclictest19688-21cut20:37:201
19222997249,14cyclictest19688-21cut20:37:201
19222997249,13cyclictest0-21swapper/119:27:431
19222997249,13cyclictest0-21swapper/119:27:431
19222997249,12cyclictest0-21swapper/119:47:241
19222997248,13cyclictest0-21swapper/119:02:221
19222997248,13cyclictest0-21swapper/119:02:221
19222997245,10cyclictest181rcu_preempt00:11:331
19222997245,10cyclictest181rcu_preempt00:11:331
19222997243,13cyclictest0-21swapper/119:57:221
19222997243,13cyclictest0-21swapper/119:57:221
19213997242,10cyclictest181rcu_preempt00:21:060
19213997242,10cyclictest181rcu_preempt00:21:060
19213997239,9cyclictest181rcu_preempt20:27:310
19213997239,9cyclictest181rcu_preempt20:27:310
19213997239,9cyclictest181rcu_preempt20:04:260
19213997239,9cyclictest181rcu_preempt20:04:260
1921399723,55cyclictest2852-21unixbench_multi19:42:550
19213997234,10cyclictest11608-21modprobe20:12:210
1922999717,43cyclictest0-21swapper/220:37:572
1922999717,43cyclictest0-21swapper/220:37:572
19222997155,10cyclictest30199-21diskmemload23:44:341
19222997149,16cyclictest24749-21latency_hist22:42:241
19222997139,10cyclictest181rcu_preempt22:12:501
19222997139,10cyclictest181rcu_preempt22:12:501
19222997135,8cyclictest181rcu_preempt20:27:421
19222997135,8cyclictest181rcu_preempt20:27:421
19213997137,8cyclictest181rcu_preempt21:52:350
19213997135,12cyclictest181rcu_preempt23:44:280
1921399713,36cyclictest7775-21ssh00:02:220
19213997133,29cyclictest0-21swapper/023:02:450
1922999703,56cyclictest30529-21ntpq21:02:532
1922299707,25cyclictest312-21apt-get19:37:351
19222997049,9cyclictest0-21swapper/123:07:361
19222997049,9cyclictest0-21swapper/123:07:361
19222997049,8cyclictest31-21ksoftirqd/119:09:031
19213997048,14cyclictest0-21swapper/019:27:560
19213997048,14cyclictest0-21swapper/019:27:560
1921399704,34cyclictest352-21runrttasks20:12:390
1921399703,33cyclictest10276-21awk23:12:200
1921399703,33cyclictest10276-21awk23:12:200
19213997032,8cyclictest181rcu_preempt21:18:240
19213997028,12cyclictest181rcu_preempt20:48:110
1922999692,41cyclictest26320-21acpi19:17:312
19213996937,9cyclictest181rcu_preempt19:17:380
19213996916,20cyclictest0-21swapper/020:17:480
19222996843,11cyclictest181rcu_preempt19:20:101
19222996840,10cyclictest181rcu_preempt22:42:471
19222996826,18cyclictest0-21swapper/121:04:361
19222996749,8cyclictest0-21swapper/119:52:241
19222996743,18cyclictest19200-21cyclictest22:02:521
19222996743,18cyclictest19200-21cyclictest22:02:521
19213996736,22cyclictest10045-21ntp_offset21:22:500
19213996731,9cyclictest28313-21latency19:22:460
19213996731,9cyclictest28313-21latency19:22:460
1923799667,35cyclictest27607-21chrt22:47:223
19222996534,13cyclictest0-21swapper/122:57:411
1922299644,38cyclictest7031-21fschecks_time19:57:421
1922299644,38cyclictest7031-21fschecks_time19:57:421
1921399623,41cyclictest5162-21/usr/sbin/munin19:52:420
1921399623,41cyclictest5162-21/usr/sbin/munin19:52:420
1923799613,45cyclictest22727-21taskset23:32:393
1923799583,35cyclictest31288-21chrt23:47:233
1923799572,36cyclictest28789-21taskset21:00:053
1923799566,37cyclictest13527-21chrt00:11:483
1923799566,37cyclictest13527-21chrt00:11:483
1923799564,36cyclictest22847-21taskset19:07:213
1923799563,34cyclictest14208-21chrt22:23:383
1923799553,38cyclictest20097-21chrt23:27:483
1923799553,34cyclictest11424-21taskset22:19:123
1923799553,34cyclictest11424-21taskset22:19:123
1923799552,38cyclictest31891-21taskset21:59:083
1923799552,37cyclictest21799-21taskset20:42:363
1923799543,36cyclictest24270-21chrt21:47:243
1923799543,35cyclictest23057-21taskset22:38:133
1923799543,34cyclictest7496-21chrt22:12:513
1923799543,34cyclictest7496-21chrt22:12:513
1923799543,33cyclictest19378-21chrt18:57:323
1923799543,33cyclictest19378-21chrt18:57:323
1923799542,35cyclictest1669-21chrt19:42:213
1923799542,28cyclictest917-21kworker/3:1+events23:02:353
1923799533,39cyclictest31947-21taskset22:52:573
1923799533,35cyclictest26514-21chrt19:17:423
1923799533,34cyclictest5102-21chrt23:57:363
1923799533,34cyclictest14332-21chrt00:12:453
19237995326,14cyclictest215402chrt22:37:203
1923799532,36cyclictest1778-21chrt22:03:023
1923799532,36cyclictest1778-21chrt22:03:023
1923799532,35cyclictest16359-21chrt22:27:473
1923799524,31cyclictest15552-21chrt20:22:473
1923799524,31cyclictest15552-21chrt20:22:473
1923799523,35cyclictest18622-21chrt23:25:423
1923799523,34cyclictest24528-21chrt19:12:233
1923799523,34cyclictest18837-21chrt21:37:483
1923799523,32cyclictest12107-21taskset20:12:433
1923799522,35cyclictest21606-21taskset20:42:243
1923799522,35cyclictest21606-21taskset20:42:243
1923799522,33cyclictest30009-21chrt19:27:463
1923799522,33cyclictest30009-21chrt19:27:463
1923799522,32cyclictest4080-21chrt22:07:403
1923799513,37cyclictest3778-21chrt19:47:433
1923799513,35cyclictest6152-21chrt21:17:203
1923799513,32cyclictest2649-21chrt19:42:533
1923799513,30cyclictest0-21swapper/320:47:433
1923799512,36cyclictest27731-21taskset21:52:443
1923799512,35cyclictest13359-21taskset21:27:583
1923799512,34cyclictest9084-21chrt20:02:543
1923799512,34cyclictest9084-21chrt20:02:543
1923799512,34cyclictest4496-21chrt23:56:393
1923799503,34cyclictest7656-21chrt21:18:133
1923799503,34cyclictest29762-21taskset22:49:333
1923799503,34cyclictest16296-21taskset21:32:573
1923799503,34cyclictest11833-21chrt21:26:363
1923799503,33cyclictest2547-21taskset22:57:563
1923799503,32cyclictest2302-21chrt21:09:583
1923799503,32cyclictest18234-21chrt20:32:233
1923799503,32cyclictest18234-21chrt20:32:233
1923799502,34cyclictest13157-21chrt23:17:063
1923799494,33cyclictest15117-21chrt23:19:133
1923799494,33cyclictest15117-21chrt23:19:133
1923799493,34cyclictest8565-21taskset00:02:483
1923799493,29cyclictest917-21kworker/3:1+events19:12:413
1923799492,31cyclictest32198-21chrt23:47:553
1923799492,30cyclictest25939-21taskset23:37:463
1923799492,30cyclictest25939-21taskset23:37:463
1923799484,34cyclictest22392-21chrt00:26:313
1923799484,32cyclictest25390-21taskset20:52:393
1923799484,32cyclictest25390-21taskset20:52:393
1923799483,30cyclictest8326-21chrt23:07:543
1923799483,30cyclictest8326-21chrt23:07:543
1923799483,28cyclictest917-21kworker/3:1+events19:52:473
1923799483,28cyclictest917-21kworker/3:1+events19:52:473
1923799474,33cyclictest30896-21taskset21:03:013
1923799473,31cyclictest11239-21taskset20:09:063
1923799463,29cyclictest7348-21chrt19:57:523
1923799463,29cyclictest7348-21chrt19:57:523
1923799433,27cyclictest17556-21chrt00:17:483
1923799433,27cyclictest17556-21chrt00:17:483
1923799422,30cyclictest26216-21taskset21:49:563
1923799413,29cyclictest14638-21chrt20:20:043
1923799413,27cyclictest31176-21taskset19:32:323
1923799402,26cyclictest27938-21chrt19:22:323
1923799402,26cyclictest27938-21chrt19:22:323
1923799372,25cyclictest18341-21chrt20:32:363
1923799372,25cyclictest18341-21chrt20:32:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional