You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 17:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Mar 24, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194429913348,78cyclictest0-21swapper/210:44:522
194429913348,78cyclictest0-21swapper/210:44:522
19442991304,91cyclictest24410-21apt-get11:39:512
1844021210,8sleep0300-21rs:main0
18899212012,73sleep118986-21grep07:01:171
19442991147,76cyclictest18220-21apt-get11:29:562
194359910916,51cyclictest15-21ksoftirqd/011:50:460
1795521029,64sleep217974-21apt-get06:59:472
1944299975,61cyclictest19121-21apt-get09:44:552
1944299972,76cyclictest17985-21kworker/u18:1+ext4-rsv-conversion08:59:572
19438999774,13cyclictest0-21swapper/107:10:101
1944299954,60cyclictest26762-21apt-get07:24:542
19435999473,14cyclictest1630-21apt-key10:09:390
1944299935,77cyclictest4028-21ssh09:20:012
19435999352,7cyclictest181rcu_preempt10:20:390
183392939,58sleep018379-21if_eth007:01:000
19442999240,13cyclictest181rcu_preempt12:31:332
19435999151,7cyclictest181rcu_preempt11:36:060
1944299898,62cyclictest2875-21rm11:04:502
1944299898,62cyclictest2875-21rm11:04:502
19442998863,16cyclictest200-21systemd-journal12:14:352
19442998863,16cyclictest200-21systemd-journal12:14:352
1944299884,76cyclictest9053-21apt-get11:15:212
1943899882,40cyclictest31-21ksoftirqd/108:23:511
19442998756,9cyclictest5076-21ssh10:14:482
19442998652,10cyclictest181rcu_preempt07:59:382
19442998652,10cyclictest181rcu_preempt07:59:382
19435998658,8cyclictest181rcu_preempt11:00:040
19442998564,15cyclictest7856-21unixbench_multi12:05:132
19442998531,10cyclictest181rcu_preempt12:02:312
19442998531,10cyclictest181rcu_preempt12:02:312
19438998556,20cyclictest29706-21modprobe07:34:361
19435998565,14cyclictest26827-21diskmemload10:12:570
19442998429,16cyclictest0-21swapper/207:15:022
19435998464,9cyclictest0-21swapper/012:00:010
19435998464,9cyclictest0-21swapper/012:00:010
19435998464,14cyclictest58-21kcompactd009:10:110
19435998464,14cyclictest3761-21latency_hist09:19:390
19435998464,14cyclictest3761-21latency_hist09:19:390
19442998333,13cyclictest181rcu_preempt08:15:032
19438998362,15cyclictest26827-21diskmemload11:50:071
19435998348,7cyclictest181rcu_preempt11:27:280
19435998347,27cyclictest0-21swapper/010:00:040
1943599832,38cyclictest15-21ksoftirqd/009:06:060
1943599832,38cyclictest15-21ksoftirqd/009:06:060
1944999824,37cyclictest0-21swapper/311:14:563
19442998246,13cyclictest181rcu_preempt09:59:392
1943599827,37cyclictest15-21ksoftirqd/010:40:460
19435998263,13cyclictest14633-21sh12:17:140
19442998151,8cyclictest19746-21ssh10:39:382
19442998151,8cyclictest19746-21ssh10:39:382
19442998135,9cyclictest181rcu_preempt10:20:372
1944299812,43cyclictest39-21ksoftirqd/212:29:382
1944299812,43cyclictest39-21ksoftirqd/212:29:382
19435998114,21cyclictest15-21ksoftirqd/008:46:270
19449998013,42cyclictest0-21swapper/311:40:413
19442998047,10cyclictest181rcu_preempt11:55:462
19442998028,28cyclictest0-21swapper/207:30:032
19438998059,14cyclictest1-21systemd12:17:201
19438998012,33cyclictest31-21ksoftirqd/111:44:121
1943599807,38cyclictest15-21ksoftirqd/007:06:480
1943599807,38cyclictest15-21ksoftirqd/007:06:480
1943599807,34cyclictest15-21ksoftirqd/007:19:380
19435998059,15cyclictest26827-21diskmemload10:49:490
19435998011,34cyclictest15-21ksoftirqd/008:34:450
19442997950,14cyclictest29821-21ssh11:49:002
19442997950,14cyclictest29821-21ssh11:49:002
19442997929,9cyclictest0-21swapper/208:09:542
19442997912,17cyclictest39-21ksoftirqd/210:09:442
19438997962,9cyclictest0-21swapper/110:30:111
19438997911,35cyclictest31-21ksoftirqd/110:43:181
19435997957,9cyclictest0-21swapper/009:39:390
1943599794,41cyclictest15-21ksoftirqd/012:13:480
1943599794,41cyclictest15-21ksoftirqd/012:13:480
1943599794,34cyclictest15-21ksoftirqd/007:39:060
1943599794,34cyclictest15-21ksoftirqd/007:39:060
19435997912,38cyclictest15-21ksoftirqd/011:23:450
19435997910,36cyclictest15-21ksoftirqd/009:20:120
19442997827,14cyclictest0-21swapper/208:40:522
19438997840,8cyclictest181rcu_preempt09:44:391
19438997824,25cyclictest31-21ksoftirqd/110:58:231
19435997862,10cyclictest12575-21latency_hist09:34:390
19435997862,10cyclictest12575-21latency_hist09:34:390
19435997848,8cyclictest181rcu_preempt11:05:000
19435997848,8cyclictest181rcu_preempt11:05:000
1943599783,23cyclictest15-21ksoftirqd/011:31:100
19435997812,39cyclictest15-21ksoftirqd/008:11:490
19435997812,35cyclictest15-21ksoftirqd/010:39:390
118202780,7sleep00-21swapper/011:19:380
19442997745,9cyclictest18123-21ssh09:43:212
19442997730,12cyclictest181rcu_preempt10:44:382
19438997757,13cyclictest13692-21latency_hist10:29:391
19438997757,13cyclictest13692-21latency_hist10:29:391
19438997756,10cyclictest0-21swapper/109:20:451
19435997756,10cyclictest0-21swapper/007:34:380
19435997746,20cyclictest9714-21ssh09:29:390
19442997652,16cyclictest23610-21/usr/sbin/munin08:54:552
19442997652,16cyclictest23610-21/usr/sbin/munin08:54:552
19442997649,19cyclictest2600-21apt-key11:04:402
1944299762,36cyclictest7292-21sort08:04:532
1943899763,38cyclictest31-21ksoftirqd/108:42:261
1943899763,26cyclictest31-21ksoftirqd/110:44:551
1943899763,26cyclictest31-21ksoftirqd/110:44:551
19438997611,33cyclictest31-21ksoftirqd/108:05:141
19435997658,9cyclictest0-21swapper/011:09:580
19435997648,8cyclictest181rcu_preempt12:04:440
1943599764,37cyclictest15-21ksoftirqd/008:01:000
19435997623,31cyclictest19426-21cyclictest09:47:070
19442997552,9cyclictest181rcu_preempt09:07:142
19442997552,9cyclictest181rcu_preempt09:07:142
19442997547,11cyclictest181rcu_preempt09:35:102
19442997546,9cyclictest26827-21diskmemload12:21:402
19442997535,13cyclictest181rcu_preempt08:35:012
19442997529,19cyclictest0-21swapper/210:04:592
19442997528,8cyclictest181rcu_preempt11:34:542
1943899759,36cyclictest31-21ksoftirqd/109:54:371
1943899759,36cyclictest31-21ksoftirqd/109:54:371
19438997544,22cyclictest14308-21wc08:25:061
19438997544,22cyclictest14308-21wc08:25:061
1943899752,27cyclictest31-21ksoftirqd/108:37:121
19438997510,35cyclictest31-21ksoftirqd/109:44:421
19435997557,13cyclictest4225-21fschecks_count07:54:580
19435997557,13cyclictest4225-21fschecks_count07:54:580
1943599752,34cyclictest15-21ksoftirqd/010:27:510
1943599752,34cyclictest15-21ksoftirqd/010:27:510
1943599752,34cyclictest15-21ksoftirqd/008:41:060
19435997512,35cyclictest15-21ksoftirqd/011:44:580
19435997512,35cyclictest15-21ksoftirqd/011:44:580
19435997511,34cyclictest15-21ksoftirqd/009:02:160
19435997510,32cyclictest15-21ksoftirqd/010:55:070
1944999749,35cyclictest0-21swapper/311:29:553
19449997418,45cyclictest0-21swapper/309:44:553
1944299743,39cyclictest14227-21cut10:29:572
19442997424,14cyclictest181rcu_preempt08:29:372
19442997424,14cyclictest181rcu_preempt08:29:372
19442997418,38cyclictest0-21swapper/210:50:112
19438997423,21cyclictest31-21ksoftirqd/110:13:311
19438997414,29cyclictest31-21ksoftirqd/111:04:511
19438997414,29cyclictest31-21ksoftirqd/111:04:511
1943599748,37cyclictest15-21ksoftirqd/007:24:530
1943599747,34cyclictest15-21ksoftirqd/010:18:240
19435997456,13cyclictest23397-21kworker/u18:2-flush-0:3209:54:450
1943599743,38cyclictest15-21ksoftirqd/007:49:580
1943599743,36cyclictest15-21ksoftirqd/011:58:440
19449997316,37cyclictest0-21swapper/311:04:563
19449997316,37cyclictest0-21swapper/311:04:563
19442997345,9cyclictest181rcu_preempt11:09:582
1944299733,46cyclictest15492-21fschecks_count08:29:582
19442997332,13cyclictest181rcu_preempt08:20:042
19442997331,17cyclictest181rcu_preempt09:17:422
19442997331,17cyclictest181rcu_preempt09:17:422
19442997330,9cyclictest181rcu_preempt11:20:102
19438997356,10cyclictest8795-21latency_hist11:14:391
19438997354,10cyclictest0-21swapper/109:01:061
19438997353,11cyclictest0-21swapper/111:31:411
19438997343,22cyclictest3699-21cron07:54:361
19438997326,23cyclictest31-21ksoftirqd/109:58:531
19438997324,21cyclictest31-21ksoftirqd/111:44:401
19438997324,21cyclictest31-21ksoftirqd/111:44:401
19435997357,7cyclictest0-21swapper/010:35:100
19435997349,10cyclictest181rcu_preempt10:45:430
19435997349,10cyclictest181rcu_preempt10:45:430
19435997348,17cyclictest18795-21ssh12:24:510
19435997348,17cyclictest18795-21ssh12:24:510
1944999724,41cyclictest0-21swapper/307:24:543
19442997238,11cyclictest181rcu_preempt11:25:072
1944299723,39cyclictest39-21ksoftirqd/209:28:162
1944299723,38cyclictest7120-21cat08:04:382
19438997253,13cyclictest200-21systemd-journal11:24:361
1943599728,35cyclictest15-21ksoftirqd/007:47:590
19435997257,7cyclictest0-21swapper/010:34:380
1944999719,47cyclictest23240-21chrt10:44:553
1944999719,47cyclictest23240-21chrt10:44:553
19442997151,14cyclictest297-21systemd-logind10:59:362
19442997136,12cyclictest181rcu_preempt08:50:112
19442997134,13cyclictest181rcu_preempt09:29:532
19442997134,13cyclictest181rcu_preempt09:29:532
19442997128,9cyclictest181rcu_preempt09:09:532
19442997121,26cyclictest0-21swapper/207:19:462
19438997156,9cyclictest28793-21modprobe10:54:351
19438997155,8cyclictest0-21swapper/107:39:371
19438997155,8cyclictest0-21swapper/107:39:371
19438997153,12cyclictest1-21systemd11:39:371
19438997125,19cyclictest31-21ksoftirqd/110:03:531
1943899712,38cyclictest31-21ksoftirqd/110:17:561
19435997156,9cyclictest13748-21cpuspeed08:24:500
19435997156,9cyclictest13748-21cpuspeed08:24:500
19435997156,8cyclictest0-21swapper/008:20:120
1943599715,46cyclictest15-21ksoftirqd/008:50:070
1943599713,37cyclictest15-21ksoftirqd/009:42:360
1943599712,38cyclictest15-21ksoftirqd/011:40:440
19449997017,47cyclictest0-21swapper/308:59:573
19442997059,8cyclictest19426-21cyclictest09:51:242
19442997059,8cyclictest19426-21cyclictest09:51:242
19442997049,8cyclictest181rcu_preempt08:45:312
19442997039,9cyclictest15195-21ssh12:18:502
1944299702,31cyclictest23033-21munin-run07:14:362
19442997018,26cyclictest0-21swapper/210:00:152
19442997010,12cyclictest2764-21cat07:50:022
1943899705,33cyclictest31-21ksoftirqd/109:33:211
1943899705,33cyclictest31-21ksoftirqd/109:33:211
19438997053,11cyclictest277-21dbus-daemon09:19:361
19438997053,11cyclictest277-21dbus-daemon09:19:361
1943899702,35cyclictest31-21ksoftirqd/110:08:251
19438997020,21cyclictest31-21ksoftirqd/112:06:351
19438997019,28cyclictest31-21ksoftirqd/108:58:261
19438997019,28cyclictest31-21ksoftirqd/108:58:261
1943599705,31cyclictest15-21ksoftirqd/007:21:580
1943599703,36cyclictest15-21ksoftirqd/007:39:540
19435997013,40cyclictest15-21ksoftirqd/008:30:270
1944299698,21cyclictest0-21swapper/207:09:402
1944299698,21cyclictest0-21swapper/207:09:402
1944299692,33cyclictest30599-21fschecks_count11:49:572
19438996953,11cyclictest200-21systemd-journal11:00:201
19438996951,12cyclictest1-21systemd08:13:241
19438996947,15cyclictest300-21rs:main1
1943899691,35cyclictest31-21ksoftirqd/112:24:511
1943899691,35cyclictest31-21ksoftirqd/112:24:511
19438996913,28cyclictest31-21ksoftirqd/109:04:491
19438996913,28cyclictest31-21ksoftirqd/109:04:491
19435996940,22cyclictest0-21swapper/008:05:020
1943599693,35cyclictest15-21ksoftirqd/007:14:260
19435996911,39cyclictest15-21ksoftirqd/012:29:570
19442996844,7cyclictest0-21swapper/207:45:012
1943899689,33cyclictest31-21ksoftirqd/112:19:491
19438996853,9cyclictest12594-21ssh12:14:381
19438996853,9cyclictest12594-21ssh12:14:381
19438996848,14cyclictest21733-21sh08:49:361
1943899683,44cyclictest31-21ksoftirqd/107:23:221
19438996830,9cyclictest181rcu_preempt11:58:461
1943899682,26cyclictest31-21ksoftirqd/109:11:221
1943599687,35cyclictest15-21ksoftirqd/008:16:180
19435996849,13cyclictest22395-21fschecks_time09:49:580
19435996849,13cyclictest22395-21fschecks_time09:49:580
19438996733,9cyclictest181rcu_preempt07:45:061
1943899673,25cyclictest31-21ksoftirqd/110:37:241
1943899673,25cyclictest31-21ksoftirqd/110:37:241
19438996730,8cyclictest181rcu_preempt12:01:461
19438996730,8cyclictest181rcu_preempt12:01:461
19438996724,35cyclictest16176-21ssh11:25:251
19435996734,10cyclictest181rcu_preempt08:55:060
19435996734,10cyclictest181rcu_preempt08:55:060
19442996628,8cyclictest181rcu_preempt10:25:112
19442996628,8cyclictest181rcu_preempt10:25:112
19442996623,9cyclictest0-21swapper/207:39:572
1943899667,32cyclictest31-21ksoftirqd/112:31:101
19438996649,12cyclictest19426-21cyclictest08:50:111
1943899663,35cyclictest31-21ksoftirqd/108:32:511
1943899662,21cyclictest31-21ksoftirqd/109:27:491
1944999653,37cyclictest917-21kworker/3:1+events07:49:583
19442996528,8cyclictest181rcu_preempt07:34:522
19442996528,8cyclictest181rcu_preempt07:34:522
1943899656,25cyclictest31-21ksoftirqd/109:35:261
19438996547,13cyclictest352-21runrttasks11:15:291
1943899654,30cyclictest31-21ksoftirqd/107:04:471
1943899654,30cyclictest31-21ksoftirqd/107:04:471
1943899652,29cyclictest31-21ksoftirqd/107:56:581
1943899652,29cyclictest31-21ksoftirqd/107:56:581
1943899642,25cyclictest31-21ksoftirqd/108:00:101
1943899642,21cyclictest31-21ksoftirqd/107:14:561
19438996412,29cyclictest31-21ksoftirqd/110:19:471
19438996333,8cyclictest181rcu_preempt07:24:521
1840826315,31sleep30-21swapper/307:01:033
1943899627,19cyclictest31-21ksoftirqd/107:39:521
133572620,3sleep30-21swapper/311:20:513
1944999617,32cyclictest0-21swapper/310:10:133
1944999593,39cyclictest6965-21chrt12:04:523
1944999584,39cyclictest18854-21chrt08:40:443
1944999582,33cyclictest0-21swapper/309:19:503
1944999572,40cyclictest2416-21chrt11:56:213
1944999572,35cyclictest3193-21chrt09:19:053
1944999572,35cyclictest3193-21chrt09:19:053
1944999563,35cyclictest25350-21taskset08:59:393
1944999563,35cyclictest25350-21taskset08:59:393
1944999562,36cyclictest15308-21taskset10:30:483
1944999562,33cyclictest917-21kworker/3:1+events09:29:573
1944999562,33cyclictest917-21kworker/3:1+events09:29:573
1944999553,35cyclictest11420-21taskset08:15:123
1944999553,30cyclictest917-21kworker/3:1+events08:10:073
1944999553,24cyclictest0-21swapper/311:14:353
1944999552,35cyclictest917-21kworker/3:1+events09:09:543
1944999543,38cyclictest8046-21taskset08:05:123
1944999543,35cyclictest9153-21chrt09:28:263
1944999543,32cyclictest18509-21taskset08:39:383
1944999542,41cyclictest2008-21chrt11:03:483
1944999533,34cyclictest13600-21chrt12:15:103
1944999533,32cyclictest13867-21chrt10:29:393
1944999533,32cyclictest13867-21chrt10:29:393
1944999533,16cyclictest0-21swapper/310:14:563
1944999532,35cyclictest23887-21chrt11:39:363
1944999532,32cyclictest26232-21chrt09:55:143
1944999524,35cyclictest28121-21taskset11:45:073
1944999524,35cyclictest28121-21taskset11:45:073
1944999523,38cyclictest25418-21taskset07:20:043
1944999523,34cyclictest16043-21chrt09:39:533
1944999523,33cyclictest20473-21taskset08:44:533
1944999523,33cyclictest19404-21chrt12:25:063
1944999523,33cyclictest19404-21chrt12:25:063
1944999523,33cyclictest15168-21chrt08:29:383
1944999523,33cyclictest15168-21chrt08:29:383
1944999522,37cyclictest29574-21chrt09:08:553
1944999522,37cyclictest29574-21chrt09:08:553
6552510,7sleep30-21swapper/307:44:383
1944999513,34cyclictest26306-21chrt10:49:543
1944999513,32cyclictest23283-21chrt09:50:233
1944999513,32cyclictest23283-21chrt09:50:233
1944999513,31cyclictest15388-21chrt11:25:003
1944999512,34cyclictest28473-21chrt07:29:523
1944999512,34cyclictest23510-21chrt12:32:083
1944999512,34cyclictest1231-21chrt07:45:033
1944999503,36cyclictest29077-21taskset10:00:123
1944999503,35cyclictest513-21chrt11:54:313
1944999503,33cyclictest16021-21chrt08:30:113
1944999502,34cyclictest14394-21chrt09:36:163
1944999502,29cyclictest0-21swapper/310:19:513
1944999493,31cyclictest12178-21chrt08:19:543
1944999493,28cyclictest6003-21chrt08:00:013
1944999492,34cyclictest23580-21taskset07:14:583
1944999492,31cyclictest4160-21chrt07:54:553
1944999492,31cyclictest4160-21chrt07:54:553
1944999492,31cyclictest31358-21chrt07:39:363
1944999492,31cyclictest31358-21chrt07:39:363
1944999483,35cyclictest29816-21chrt10:55:093
1944999483,33cyclictest21303-21chrt10:40:503
1944999482,35cyclictest18256-21chrt10:35:393
1944999482,35cyclictest18256-21chrt10:35:393
1944999473,32cyclictest21104-21chrt07:09:393
1944999473,32cyclictest21104-21chrt07:09:393
1944999472,33cyclictest15799-21chrt12:19:483
1944999462,30cyclictest4409-21chrt12:00:023
1944999462,30cyclictest4409-21chrt12:00:023
19449994613,17cyclictest0-21swapper/310:04:573
1944999453,29cyclictest11881-21chrt12:12:553
1944999453,29cyclictest11881-21chrt12:12:553
1944999433,30cyclictest22468-21chrt08:50:033
19449994221,9cyclictest0-21swapper/307:09:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional