You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 14:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Apr 10, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5116991363,45cyclictest4985-21latency_hist07:03:320
4966212713,77sleep14997-21apt07:03:281
51169911647,61cyclictest21417-21latency_hist11:58:310
375121169,68sleep23793-21df06:58:482
51169911533,16cyclictest0-21swapper/010:43:310
51169911014,37cyclictest23459-21latency10:13:530
51169910751,10cyclictest29803-21ssh10:23:540
51269910514,68cyclictest26295-21sshd10:18:512
51269910514,68cyclictest26295-21sshd10:18:512
5116991054,40cyclictest1345-21mailstats08:29:000
5116991043,35cyclictest12342-21/usr/sbin/munin11:43:500
5116991038,23cyclictest0-21swapper/009:24:010
5116991033,38cyclictest22850-21unixbench_singl07:54:040
5116991033,28cyclictest8430-21apt-get10:43:350
5121991027,79cyclictest8518-21apt-get08:53:411
5116991012,37cyclictest18618-21sed09:13:310
5126999910,57cyclictest0-21swapper/208:13:522
5126999745,45cyclictest3566-21cut12:23:292
5126999548,38cyclictest15499-21rm09:08:322
5126999531,39cyclictest0-21swapper/211:09:032
512699943,80cyclictest0-21swapper/211:48:402
512699943,80cyclictest0-21swapper/211:48:402
5126999354,34cyclictest5107-21cyclictest10:29:012
5126999330,54cyclictest12009-21diskmemload09:33:122
512199938,52cyclictest31-21ksoftirqd/110:22:051
512199938,52cyclictest31-21ksoftirqd/110:22:051
512199937,57cyclictest31-21ksoftirqd/111:09:051
5121999369,15cyclictest870-21ssh09:36:301
512199923,67cyclictest25333-21apt-get09:24:201
5121999115,52cyclictest31-21ksoftirqd/112:32:371
512199902,75cyclictest15846-21modprobe09:09:241
5121998967,14cyclictest5107-21cyclictest10:09:011
5121998950,15cyclictest181rcu_preempt07:53:301
511699893,42cyclictest9964-21kworker/u18:0+flush-179:011:59:220
511699893,42cyclictest9964-21kworker/u18:0+flush-179:011:59:220
512699882,75cyclictest0-21swapper/207:38:422
5126998741,38cyclictest0-21swapper/210:08:312
512699873,75cyclictest0-21swapper/212:28:372
5126998645,34cyclictest0-21swapper/209:18:532
512699863,63cyclictest352-21runrttasks09:14:082
5126998634,44cyclictest0-21swapper/210:44:282
512699862,67cyclictest25078-21apt-get09:24:012
5126998612,47cyclictest298-21in:imuxsock07:08:272
5126998548,31cyclictest5107-21cyclictest07:24:042
5126998544,34cyclictest25230-21timerandwakeup12:04:022
5121998550,26cyclictest8817-21apt-key08:53:321
511699857,59cyclictest26245-21ssh10:18:440
511699857,59cyclictest26245-21ssh10:18:440
5116998554,13cyclictest181rcu_preempt09:28:390
5116998550,10cyclictest181rcu_preempt12:28:370
5126998440,37cyclictest0-21swapper/209:09:392
512699843,75cyclictest0-21swapper/211:18:432
512699843,75cyclictest0-21swapper/211:18:432
5126998413,39cyclictest12009-21diskmemload10:00:112
512699833,72cyclictest0-21swapper/209:53:432
512699833,72cyclictest0-21swapper/209:53:432
512199832,57cyclictest31-21ksoftirqd/109:39:021
5116998311,63cyclictest18837-21apt-get09:14:200
39142838,55sleep30-21swapper/306:58:573
512699827,50cyclictest0-21swapper/207:38:312
5126998265,10cyclictest7636-21needreboot08:48:552
5126998238,37cyclictest26761-21sh11:13:322
512699822,75cyclictest0-21swapper/211:38:412
512699822,75cyclictest0-21swapper/211:38:412
5126998225,29cyclictest0-21swapper/212:02:002
5126998225,29cyclictest0-21swapper/212:02:002
5121998244,12cyclictest181rcu_preempt09:55:191
5121998244,12cyclictest181rcu_preempt09:55:191
5121998243,17cyclictest181rcu_preempt07:57:371
511699827,60cyclictest31385-21ssh09:33:440
5116998254,20cyclictest15306-21apt-key09:08:320
5126998160,15cyclictest21050-21latency_hist11:58:302
512699813,66cyclictest0-21swapper/209:38:382
5126998134,40cyclictest14929-21/usr/sbin/munin10:53:512
512699812,74cyclictest0-21swapper/207:53:432
5121998164,11cyclictest5107-21cyclictest11:49:281
5121998164,11cyclictest5107-21cyclictest11:49:281
512199812,35cyclictest2058-21latency_hist08:33:311
5121998119,18cyclictest0-21swapper/108:37:381
5116998161,15cyclictest544-21cron08:48:280
512699804,71cyclictest0-21swapper/211:43:392
5126998044,31cyclictest2523-21kworker/u17:4-ext4-rsv-conversion11:08:312
512699802,64cyclictest18645-21apt-get07:43:392
5126998010,58cyclictest29332-21cstates10:23:422
512199806,44cyclictest31-21ksoftirqd/110:53:441
5121998053,12cyclictest181rcu_preempt12:18:311
5121998047,11cyclictest181rcu_preempt07:09:011
5121998047,11cyclictest181rcu_preempt07:09:011
5126997959,14cyclictest6351-21ntp_offset10:38:562
5126997957,12cyclictest10833-21latency_hist09:53:312
512699794,66cyclictest3954-21apt-get08:38:402
5126997940,32cyclictest0-21swapper/211:26:562
512699793,64cyclictest0-21swapper/207:48:422
5126997936,37cyclictest0-21swapper/212:09:002
5126997932,41cyclictest0-21swapper/211:33:552
512699792,65cyclictest0-21swapper/208:23:422
512199798,47cyclictest31-21ksoftirqd/110:33:081
5121997948,22cyclictest30226-21sh12:13:321
5121997943,8cyclictest181rcu_preempt10:33:441
512199793,37cyclictest31-21ksoftirqd/111:43:301
512199793,37cyclictest31-21ksoftirqd/111:43:301
5121997924,25cyclictest31-21ksoftirqd/107:18:291
5121997924,25cyclictest31-21ksoftirqd/107:18:291
5121997917,31cyclictest31-21ksoftirqd/107:20:311
5121997917,31cyclictest31-21ksoftirqd/107:20:311
5116997957,14cyclictest6085-21sendmail11:33:270
5116997957,14cyclictest6085-21sendmail11:33:270
5116997939,23cyclictest7643-21ssh09:48:290
5116997939,23cyclictest7643-21ssh09:48:290
512699783,70cyclictest0-21swapper/210:08:382
5121997855,8cyclictest181rcu_preempt11:58:361
5121997855,8cyclictest181rcu_preempt11:58:361
5121997837,14cyclictest181rcu_preempt12:17:091
5116997862,10cyclictest12009-21diskmemload11:08:310
5116997858,14cyclictest14063-21fschecks_time07:28:490
5126997758,13cyclictest30948-21sh12:13:552
5126997747,21cyclictest11174-21wc07:19:012
5126997747,21cyclictest11174-21wc07:19:012
512699772,52cyclictest5670-21latency_hist10:38:312
5121997744,17cyclictest181rcu_preempt10:58:361
5121997739,17cyclictest181rcu_preempt08:47:451
5121997735,15cyclictest181rcu_preempt08:15:111
5121997733,15cyclictest0-21swapper/108:41:581
512199772,47cyclictest31-21ksoftirqd/108:05:341
5121997720,34cyclictest0-21swapper/112:04:431
512699763,60cyclictest0-21swapper/208:33:312
5121997652,10cyclictest181rcu_preempt07:04:441
5121997649,13cyclictest181rcu_preempt11:26:481
5121997642,8cyclictest181rcu_preempt10:52:591
5121997642,13cyclictest181rcu_preempt10:04:371
5121997638,12cyclictest181rcu_preempt09:46:371
5121997638,12cyclictest181rcu_preempt09:46:371
5121997637,16cyclictest181rcu_preempt07:40:061
5121997636,10cyclictest181rcu_preempt09:06:541
5121997633,10cyclictest31-21ksoftirqd/109:28:531
5121997629,14cyclictest181rcu_preempt11:37:281
5121997610,45cyclictest31-21ksoftirqd/111:13:371
5116997653,17cyclictest11342-21sh09:53:510
5116997653,17cyclictest11342-21sh09:53:510
512699753,67cyclictest0-21swapper/210:13:412
512699752,68cyclictest0-21swapper/207:58:402
5126997523,45cyclictest4952-21sh11:30:212
5126997523,45cyclictest4952-21sh11:30:212
5121997553,8cyclictest181rcu_preempt12:24:221
5121997551,9cyclictest181rcu_preempt09:48:491
5121997550,19cyclictest26912-21fschecks_count08:08:501
5121997549,19cyclictest23223-21fschecks_count10:13:481
5121997548,8cyclictest181rcu_preempt10:43:191
512199753,43cyclictest31-21ksoftirqd/111:21:171
512199753,43cyclictest31-21ksoftirqd/111:21:171
512199752,53cyclictest18837-21apt-get09:13:431
512199752,33cyclictest31-21ksoftirqd/111:32:591
512199752,33cyclictest31-21ksoftirqd/111:32:591
5116997560,9cyclictest17848-21ssh10:04:020
5116997547,18cyclictest0-21swapper/010:38:300
511699754,43cyclictest6838-21kernelversion11:33:520
511699753,55cyclictest14649-21processes09:58:590
5116997526,25cyclictest0-21swapper/011:08:530
512699743,66cyclictest0-21swapper/207:08:422
512699743,66cyclictest0-21swapper/207:08:422
512699742,64cyclictest26708-21apt-get08:08:402
5121997447,20cyclictest23585-21latency_hist11:08:301
5121997434,9cyclictest181rcu_preempt09:22:341
5116997458,11cyclictest7572-21fschecks_time07:08:520
5116997458,11cyclictest7572-21fschecks_time07:08:520
5116997451,14cyclictest32048-21sh12:15:410
5116997447,22cyclictest5107-21cyclictest09:38:460
5116997447,18cyclictest12229-21cut10:48:510
512699733,63cyclictest29955-21apt-get08:18:432
512699733,62cyclictest0-21swapper/209:37:492
5126997328,37cyclictest0-21swapper/208:06:012
5126997315,50cyclictest9646-21proc_pri08:54:252
5121997346,13cyclictest181rcu_preempt11:43:431
5121997344,21cyclictest29543-21fschecks_time10:23:481
5116997359,9cyclictest30143-21ssh11:18:510
5116997359,9cyclictest30143-21ssh11:18:510
5116997358,9cyclictest20174-21fschecks_count10:08:470
5116997357,10cyclictest1459-21ntp_kernel_err12:18:570
5116997356,12cyclictest22100-21fschecks_count09:18:490
5116997353,15cyclictest10554-21latency_hist08:58:300
511699733,43cyclictest17996-21grep07:39:030
511699733,35cyclictest18076-21basename11:53:270
511699733,35cyclictest18076-21basename11:53:270
512699723,64cyclictest0-21swapper/209:43:422
512699723,64cyclictest0-21swapper/209:43:422
512699722,65cyclictest0-21swapper/212:23:392
512699722,54cyclictest19768-21ssh11:01:072
5121997259,9cyclictest2523-21kworker/u17:4-xprtiod10:44:481
512199722,42cyclictest31-21ksoftirqd/108:02:431
511699723,39cyclictest17924-21/usr/sbin/munin10:58:560
511699723,38cyclictest10399-21grep11:39:040
511699723,38cyclictest10399-21grep11:39:040
512699713,60cyclictest6955-21latency_hist08:48:292
5126997128,35cyclictest0-21swapper/210:51:272
512699712,59cyclictest13803-21apt-get07:28:432
5121997145,17cyclictest0-21swapper/108:19:031
5116997155,11cyclictest29800-21ssh12:12:490
511699714,37cyclictest6547-21munin-plugin-st12:28:270
5121997049,11cyclictest0-21swapper/107:44:051
5121997048,16cyclictest16189-21threads07:34:011
5121997045,16cyclictest10641-21/usr/sbin/munin08:58:521
5116997055,9cyclictest29705-21rm11:18:300
5116997050,14cyclictest15305-21sh10:53:510
5116997038,13cyclictest181rcu_preempt10:28:430
513499697,41cyclictest0-21swapper/308:53:523
512699693,55cyclictest9325-21/usr/sbin/munin07:13:512
512699693,55cyclictest9325-21/usr/sbin/munin07:13:512
512699693,55cyclictest2348-21apt-get08:33:422
5121996938,22cyclictest18488-21wc11:53:411
512199693,44cyclictest352-21runrttasks10:03:251
5116996950,14cyclictest824-21sh11:23:520
5116996941,20cyclictest19985-21idleruntime-cro07:48:280
5116996938,10cyclictest181rcu_preempt08:13:440
511699693,48cyclictest21143-21grep07:49:040
5134996811,37cyclictest0-21swapper/309:33:443
512699682,55cyclictest10642-21/usr/sbin/munin08:58:372
5121996823,31cyclictest31684-21ls08:23:441
5116996843,17cyclictest0-21swapper/009:48:380
5116996842,17cyclictest25330-21fschecks_time08:03:490
5116996842,12cyclictest0-21swapper/008:51:510
5116996733,14cyclictest181rcu_preempt08:59:000
513499669,17cyclictest0-21swapper/311:59:183
513499669,17cyclictest0-21swapper/311:59:183
512199663,36cyclictest12414-21fschecks_count07:23:471
5116996650,10cyclictest29936-21munin-node08:18:390
5116996635,9cyclictest181rcu_preempt12:03:480
5121996529,8cyclictest181rcu_preempt07:29:191
511699653,42cyclictest13747-21latency_hist07:28:310
511699652,33cyclictest10988-21latency07:18:540
511699652,33cyclictest10988-21latency07:18:540
513499646,43cyclictest0-21swapper/309:24:103
5116996444,14cyclictest4891-21unixbench_singl08:39:040
511699643,31cyclictest23477-21/usr/sbin/munin07:58:510
5116996428,8cyclictest0-21swapper/007:33:550
511699633,33cyclictest9172-21fschecks_count07:13:490
511699633,33cyclictest9172-21fschecks_count07:13:490
5116996321,31cyclictest5878-21seq07:03:590
5116996214,17cyclictest3695-21munin-run08:38:280
513499608,39cyclictest0-21swapper/310:18:423
513499608,39cyclictest0-21swapper/310:18:423
513499606,28cyclictest0-21swapper/309:14:253
513499603,38cyclictest0-21swapper/309:08:513
511699603,40cyclictest31743-21fschecks_count08:23:480
5116996032,20cyclictest26901-21tune2fs08:08:500
513499594,44cyclictest30191-21taskset12:13:303
513499594,39cyclictest13889-21taskset07:28:443
513499573,36cyclictest28289-21taskset08:13:313
513499544,39cyclictest16348-21taskset10:02:413
513499544,38cyclictest18030-21chrt11:53:273
513499544,38cyclictest18030-21chrt11:53:273
513499543,37cyclictest13865-21chrt09:58:313
513499543,37cyclictest13865-21chrt09:58:313
513499537,33cyclictest5386-21chrt09:43:533
513499537,33cyclictest5386-21chrt09:43:533
513499533,40cyclictest32521-21taskset08:24:043
513499533,36cyclictest22257-21taskset09:18:523
513499524,35cyclictest4260-21chrt11:29:033
513499524,35cyclictest4260-21chrt11:29:033
513499523,36cyclictest26351-21taskset11:12:533
513499523,36cyclictest17482-21chrt07:38:523
513499523,35cyclictest8942-21chrt12:31:513
513499523,35cyclictest19928-21chrt10:08:363
513499522,34cyclictest5325-21taskset12:25:023
513499514,32cyclictest3503-21taskset09:40:283
513499513,36cyclictest1109-21chrt12:18:493
513499513,35cyclictest8529-21taskset08:53:283
513499513,35cyclictest314-21chrt11:23:313
513499513,35cyclictest314-21chrt11:23:313
513499504,33cyclictest11004-21taskset10:46:433
513499503,37cyclictest8044-21chrt11:35:353
513499503,37cyclictest10777-21chrt11:39:533
513499503,37cyclictest10777-21chrt11:39:533
513499503,36cyclictest23768-21taskset11:08:313
513499503,34cyclictest6090-21chrt07:04:023
513499503,34cyclictest2462-21chrt08:33:443
513499494,35cyclictest24621-21chrt10:15:333
513499493,37cyclictest917-21kworker/3:1+events10:27:463
513499493,34cyclictest5632-21taskset08:43:443
513499493,32cyclictest31516-21chrt08:23:313
513499493,32cyclictest11223-21chrt08:58:593
513499492,33cyclictest4404-21taskset08:38:543
513499492,32cyclictest15925-21taskset07:33:543
513499483,32cyclictest9837-21chrt09:51:223
513499483,32cyclictest28864-21chrt09:29:013
513499474,32cyclictest25584-21chrt08:03:553
513499473,33cyclictest17794-21chrt10:58:303
513499473,31cyclictest29109-21chrt11:17:113
513499473,30cyclictest7881-21chrt07:09:003
513499473,30cyclictest7881-21chrt07:09:003
513499472,31cyclictest13637-21chrt10:50:443
513499472,31cyclictest12619-21chrt09:03:483
513499463,33cyclictest2945-21chrt10:33:453
513499463,33cyclictest17146-21taskset10:03:463
513499463,32cyclictest7966-21taskset10:42:123
513499463,30cyclictest18924-21chrt07:43:513
513499463,30cyclictest13914-21chrt11:45:203
513499463,29cyclictest25669-21chrt12:04:393
513499463,29cyclictest20412-21chrt07:48:493
513499463,29cyclictest1721-21taskset10:31:303
513499462,35cyclictest19706-21chrt11:54:413
513499462,31cyclictest28827-21taskset08:13:553
513499462,30cyclictest11140-21chrt07:19:003
513499462,30cyclictest11140-21chrt07:19:003
513499454,32cyclictest22336-21chrt07:53:553
513499453,32cyclictest533-21taskset11:23:433
513499453,32cyclictest20355-21chrt11:02:483
513499443,27cyclictest32143-21chrt12:15:583
513499423,27cyclictest9131-21chrt07:13:463
513499423,27cyclictest9131-21chrt07:13:463
513499422,26cyclictest13021-21taskset07:24:023
513499402,28cyclictest2014-21taskset08:33:073
513499392,23cyclictest917-21kworker/3:1+events07:58:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional