You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 23:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Mar 31, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7587991183,31cyclictest352-21runrttasks11:11:060
75879911143,59cyclictest0-21swapper/010:14:360
7587991114,29cyclictest352-21runrttasks10:27:160
7587991113,30cyclictest29339-21ssh09:27:570
7587991083,30cyclictest10774-21ssh10:45:080
7587991082,43cyclictest22946-21apt-get07:49:190
75879910747,53cyclictest23841-21sh09:19:110
75879910747,53cyclictest23841-21sh09:19:110
7587991073,25cyclictest19676-21snmpd10:55:150
7587991073,25cyclictest19676-21snmpd10:55:150
7587991072,25cyclictest5042-21sh11:29:220
76039910628,37cyclictest0-21swapper/208:59:212
7587991064,29cyclictest13013-21latency_hist07:19:350
7587991064,29cyclictest13013-21latency_hist07:19:350
75879910615,61cyclictest352-21runrttasks11:56:090
734421066,15sleep00-21swapper/007:03:070
6454210647,18sleep2181rcu_preempt06:59:392
7587991053,26cyclictest10125-21rm12:31:100
7597991042,84cyclictest24149-21ssh09:19:281
7587991045,10cyclictest0-21swapper/010:19:210
7587991033,30cyclictest32005-21sh12:14:200
7587991033,24cyclictest19780-21tune2fs10:59:300
7587991032,26cyclictest4636-21ssh11:28:580
7597991022,90cyclictest11695-21modprobe07:14:331
7597991022,90cyclictest11695-21modprobe07:14:331
7587991024,29cyclictest352-21runrttasks08:53:290
7587991023,29cyclictest352-21runrttasks08:55:520
7587991023,25cyclictest30236-21runrttasks11:16:320
7587991022,24cyclictest12235-21sh09:53:530
7587991014,33cyclictest31873-21if_eth011:19:320
7587991014,33cyclictest31873-21if_eth011:19:320
7587991012,22cyclictest27208-21seq08:00:100
75879910111,8cyclictest0-21swapper/009:54:200
7603991003,59cyclictest24145-21ssh09:19:272
75979910059,20cyclictest181rcu_preempt10:29:121
75979910059,20cyclictest181rcu_preempt10:29:121
7587991004,22cyclictest28957-21seq08:07:020
7587991004,22cyclictest28957-21seq08:07:020
7587991003,25cyclictest18527-21runrttasks11:50:550
7587991003,25cyclictest18527-21runrttasks11:50:550
758799994,33cyclictest352-21runrttasks11:44:220
758799994,30cyclictest352-21runrttasks09:01:390
758799993,29cyclictest24096-21apt-get09:19:440
758799993,26cyclictest29385-21/usr/sbin/munin08:09:470
758799993,25cyclictest30563-21latency09:29:340
7603999824,34cyclictest0-21swapper/208:59:102
758799983,35cyclictest9324-21ssh11:35:140
758799983,35cyclictest9324-21ssh11:35:140
758799983,35cyclictest352-21runrttasks12:23:530
758799983,27cyclictest352-21runrttasks12:13:120
758799983,27cyclictest352-21runrttasks12:13:120
758799983,23cyclictest5051-21ssh09:40:340
758799975,8cyclictest0-21swapper/012:04:240
758799975,31cyclictest21400-21unin-run10:09:090
758799974,28cyclictest8009-21tune2fs07:04:290
758799974,28cyclictest8009-21tune2fs07:04:290
7587999740,51cyclictest8696-21latency08:44:300
758799973,9cyclictest0-21swapper/010:39:200
7587999734,56cyclictest0-21swapper/010:29:430
7587999734,56cyclictest0-21swapper/010:29:430
758799972,30cyclictest352-21runrttasks09:07:410
758799972,23cyclictest17095-21ssh10:00:360
7603999628,28cyclictest0-21swapper/209:54:202
7603999623,31cyclictest31934-21latency11:19:342
7603999623,31cyclictest31934-21latency11:19:342
7597999655,8cyclictest181rcu_preempt10:49:091
758799964,30cyclictest5780-21tune2fs12:24:270
758799963,32cyclictest5706-21grep08:34:410
758799963,32cyclictest19676-21snmpd11:41:380
7603999529,28cyclictest27256-21taskset09:24:252
7603999528,22cyclictest723-21seq12:14:582
758799954,31cyclictest352-21runrttasks10:50:020
758799953,32cyclictest352-21runrttasks09:13:360
758799953,27cyclictest9348-21munin-node07:09:170
758799953,27cyclictest9348-21munin-node07:09:170
7587999532,56cyclictest3127-21cron08:29:080
758799953,21cyclictest20262-21taskset07:39:360
758799952,25cyclictest32348-21runrttasks08:18:540
758799952,22cyclictest23365-21ssh10:11:220
7603999427,24cyclictest0-21swapper/210:33:392
7603999427,24cyclictest0-21swapper/210:33:392
758799944,10cyclictest0-21swapper/009:34:200
7597999353,16cyclictest181rcu_preempt08:34:481
7597999333,15cyclictest0-21swapper/111:19:351
7597999333,15cyclictest0-21swapper/111:19:351
758799934,30cyclictest4300-21grep08:29:430
758799933,30cyclictest352-21runrttasks09:48:000
758799933,30cyclictest352-21runrttasks09:48:000
758799933,30cyclictest24557-21/usr/sbin/munin07:54:350
758799933,29cyclictest18907-21timerandwakeup07:34:430
760399923,66cyclictest10471-21apt-get10:44:402
7603999218,39cyclictest0-21swapper/207:59:352
7603999218,36cyclictest0-21swapper/209:34:192
7597999253,8cyclictest181rcu_preempt12:01:291
7597999253,8cyclictest181rcu_preempt12:01:291
758799924,33cyclictest7612-21unixbench_multi08:39:450
758799924,30cyclictest583-21wc08:19:350
758799922,25cyclictest14199-21grep07:20:000
758799922,25cyclictest14199-21grep07:20:000
7587999214,23cyclictest6279-21sh10:37:240
7603999129,26cyclictest27410-21runrttasks10:19:092
7603999128,25cyclictest17621-21seq10:54:512
7603999128,25cyclictest17621-21seq10:54:512
7597999159,12cyclictest181rcu_preempt11:06:341
758799914,31cyclictest22672-21idleruntime-cro07:49:080
7603999030,25cyclictest0-21swapper/210:42:132
7603999027,20cyclictest14912-21ssh10:50:422
7597999049,12cyclictest181rcu_preempt12:16:021
758799904,27cyclictest16597-21cstates07:29:260
758799903,31cyclictest15469-21ps07:24:410
758799903,31cyclictest15469-21ps07:24:410
7587999012,68cyclictest22477-21apt11:04:180
62682909,56sleep16293-21fschecks_count06:59:341
7603998931,28cyclictest11091-21seq08:52:092
7603998929,25cyclictest14507-21diskmemload11:45:482
7603998928,28cyclictest31017-21seq08:14:152
7597998960,19cyclictest30816-21latency_hist08:14:091
7603998828,30cyclictest5648-21seq10:35:382
7603998826,26cyclictest30526-21seq08:11:232
7603998826,23cyclictest20828-21seq07:41:102
7603998736,32cyclictest24680-21sh11:07:502
7603998731,26cyclictest7705-21/usr/sbin/munin09:44:452
7603998731,26cyclictest7705-21/usr/sbin/munin09:44:452
7603998731,24cyclictest19368-21seq07:38:062
7603998729,25cyclictest9037-21seq07:08:342
7603998729,25cyclictest9037-21seq07:08:342
7603998729,22cyclictest22520-21seq07:47:182
7603998726,27cyclictest0-21swapper/209:14:042
7603998725,26cyclictest0-21swapper/211:53:142
7603998725,26cyclictest0-21swapper/211:53:142
7597998745,16cyclictest181rcu_preempt07:24:421
7597998745,16cyclictest181rcu_preempt07:24:421
7597998739,14cyclictest0-21swapper/110:20:551
7597998727,21cyclictest0-21swapper/108:04:111
758799873,23cyclictest23346-21fschecks_time11:59:300
758799873,23cyclictest23346-21fschecks_time11:59:300
7603998630,27cyclictest16864-21seq09:07:202
7603998630,26cyclictest24092-21taskset07:51:502
7603998630,25cyclictest12846-21seq07:17:092
7603998630,25cyclictest12846-21seq07:17:092
7603998627,29cyclictest17078-21seq10:00:332
7597998659,20cyclictest14701-21latency_hist07:24:101
7597998659,20cyclictest14701-21latency_hist07:24:101
7603998529,25cyclictest3097-21seq08:28:452
7603998529,23cyclictest6131-21users11:29:482
7603998528,27cyclictest5155-21seq09:40:522
7603998528,21cyclictest28066-21ssh11:13:552
7603998526,26cyclictest0-21swapper/212:19:322
7603998522,27cyclictest0-21swapper/211:29:102
7603998520,31cyclictest0-21swapper/211:40:292
7603998517,31cyclictest0-21swapper/208:04:302
7603998517,31cyclictest0-21swapper/208:04:302
7597998553,9cyclictest181rcu_preempt12:11:031
7597998553,9cyclictest181rcu_preempt12:11:031
7597998539,10cyclictest181rcu_preempt11:34:081
7597998531,15cyclictest0-21swapper/109:15:391
7597998531,15cyclictest0-21swapper/109:15:391
7597998525,24cyclictest0-21swapper/111:00:471
7603998429,22cyclictest22121-21seq11:04:032
7603998428,27cyclictest4590-21seq08:31:362
760399842,32cyclictest9227-21unixbench_multi08:44:412
7603998422,29cyclictest23261-21fschecks_count11:59:292
7603998422,29cyclictest23261-21fschecks_count11:59:292
7603998422,21cyclictest29145-21ssh11:14:392
7603998421,24cyclictest22784-21latency_hist11:59:092
7603998331,24cyclictest20474-21seq10:06:412
7603998329,23cyclictest15972-21seq07:26:002
7603998329,23cyclictest15972-21seq07:26:002
7603998328,26cyclictest28063-21seq12:07:282
7603998328,24cyclictest6175-21seq08:36:022
7603998327,24cyclictest23336-21seq09:18:352
7603998327,24cyclictest23336-21seq09:18:352
7603998327,18cyclictest9645-21seq12:29:492
7603998326,24cyclictest352-21runrttasks09:51:462
7597998343,13cyclictest181rcu_preempt11:11:421
759799833,53cyclictest31-21ksoftirqd/110:09:571
7597998335,12cyclictest181rcu_preempt11:54:361
7597998333,13cyclictest181rcu_preempt10:51:551
759799832,28cyclictest31-21ksoftirqd/109:29:441
7603998263,12cyclictest1068-21latency_hist10:29:102
7603998231,25cyclictest24634-21cpuspeed07:54:242
7603998228,19cyclictest29295-21taskset10:21:092
7603998225,23cyclictest0-21swapper/207:29:562
7603998223,25cyclictest352-21runrttasks08:22:492
7597998249,14cyclictest181rcu_preempt07:04:291
7597998249,14cyclictest181rcu_preempt07:04:291
7597998247,8cyclictest181rcu_preempt10:56:461
7597998247,8cyclictest181rcu_preempt10:56:461
7597998241,10cyclictest181rcu_preempt09:06:371
7603998125,26cyclictest8561-21runrttasks11:34:342
7603998125,26cyclictest8561-21runrttasks11:34:342
7603998124,22cyclictest352-21runrttasks08:40:152
7603998121,33cyclictest0-21swapper/207:23:322
7603998121,33cyclictest0-21swapper/207:23:322
7603998121,22cyclictest0-21swapper/210:09:372
7597998155,9cyclictest181rcu_preempt11:34:311
7597998155,9cyclictest181rcu_preempt11:34:311
7597998147,12cyclictest181rcu_preempt07:39:421
7603998027,23cyclictest11034-21seq07:12:552
7603998027,23cyclictest11034-21seq07:12:552
7603998025,24cyclictest6796-21taskset12:25:132
7603998016,27cyclictest0-21swapper/209:29:262
7597998047,10cyclictest181rcu_preempt09:54:521
7597998045,9cyclictest181rcu_preempt09:49:521
7597998044,13cyclictest181rcu_preempt11:25:161
7597998042,13cyclictest181rcu_preempt09:13:371
7597998041,10cyclictest181rcu_preempt10:00:081
7597998035,9cyclictest181rcu_preempt08:29:351
7597998034,17cyclictest181rcu_preempt10:39:591
7597998032,12cyclictest181rcu_preempt11:42:531
7597997950,15cyclictest181rcu_preempt11:48:381
7597997948,16cyclictest181rcu_preempt08:49:331
7597997948,12cyclictest181rcu_preempt10:24:311
7597997941,14cyclictest181rcu_preempt11:14:351
7597997938,8cyclictest181rcu_preempt09:39:111
7597997929,14cyclictest0-21swapper/108:18:041
7597997928,10cyclictest0-21swapper/109:26:521
7597997923,20cyclictest0-21swapper/112:21:181
7603997828,19cyclictest31189-21ssh12:12:512
7603997828,19cyclictest31189-21ssh12:12:512
7597997853,18cyclictest3690-21cpu09:39:241
7597997850,10cyclictest181rcu_preempt10:04:561
7597997840,10cyclictest181rcu_preempt07:29:411
7597997839,9cyclictest181rcu_preempt12:04:501
7597997838,28cyclictest29133-21latency_hist08:09:081
7597997838,28cyclictest29133-21latency_hist08:09:081
7597997824,28cyclictest0-21swapper/107:54:091
7597997737,12cyclictest181rcu_preempt12:33:051
7597997732,16cyclictest181rcu_preempt09:47:141
7597997732,16cyclictest181rcu_preempt09:47:141
7597997728,15cyclictest0-21swapper/111:51:391
7597997728,15cyclictest0-21swapper/111:51:391
7597997720,27cyclictest0-21swapper/110:35:171
7609997613,43cyclictest0-21swapper/309:19:323
7597997637,16cyclictest181rcu_preempt07:45:031
7597997618,28cyclictest0-21swapper/108:24:371
7597997543,12cyclictest181rcu_preempt09:01:161
7597997540,16cyclictest181rcu_preempt07:57:151
7597997538,8cyclictest181rcu_preempt08:44:331
7597997538,13cyclictest181rcu_preempt08:19:271
7597997532,11cyclictest0-21swapper/110:15:001
7597997526,8cyclictest0-21swapper/108:39:401
7597997447,13cyclictest181rcu_preempt08:54:371
7597997342,8cyclictest181rcu_preempt07:09:181
7597997342,8cyclictest181rcu_preempt07:09:181
7597997320,25cyclictest0-21swapper/112:24:571
7597997239,12cyclictest181rcu_preempt07:38:091
215272720,7sleep30-21swapper/307:44:293
760999683,40cyclictest917-21kworker/3:1+events07:04:133
760999642,41cyclictest917-21kworker/3:1+events10:17:233
760999615,46cyclictest0-21swapper/310:44:313
760999603,40cyclictest8754-21taskset12:29:273
760999603,39cyclictest29796-21chrt09:29:083
760999603,38cyclictest917-21kworker/3:1+events07:34:103
760999603,36cyclictest917-21kworker/3:1+events10:13:213
760999583,37cyclictest917-21kworker/3:1+events11:12:053
760999583,28cyclictest917-21kworker/3:1+events11:54:313
760999573,36cyclictest15858-21chrt07:24:453
760999573,36cyclictest15858-21chrt07:24:453
760999572,38cyclictest917-21kworker/3:1+events08:29:423
760999572,33cyclictest917-21kworker/3:1+events10:19:253
1786625715,8sleep30-21swapper/310:02:483
760999563,40cyclictest9171-21taskset07:09:103
760999563,40cyclictest9171-21taskset07:09:103
760999563,36cyclictest18420-21chrt10:57:053
760999563,36cyclictest18420-21chrt10:57:053
760999563,35cyclictest917-21kworker/3:1+events08:13:423
760999556,38cyclictest11688-21taskset07:14:283
760999556,38cyclictest11688-21taskset07:14:283
760999554,33cyclictest1946-21taskset08:24:263
760999553,36cyclictest917-21kworker/3:1+events10:39:113
760999553,35cyclictest27931-21taskset08:04:263
760999553,35cyclictest27931-21taskset08:04:263
760999544,36cyclictest6144-21taskset09:43:383
760999543,37cyclictest917-21kworker/3:1+events12:19:323
760999543,35cyclictest26102-21chrt07:59:113
760999542,38cyclictest13526-21chrt08:59:333
760999542,36cyclictest10737-21chrt07:09:463
760999542,36cyclictest10737-21chrt07:09:463
760999533,34cyclictest32258-21chrt11:19:423
760999533,34cyclictest32258-21chrt11:19:423
760999533,25cyclictest917-21kworker/3:1+events08:24:113
760999532,39cyclictest9028-21taskset08:44:393
760999532,36cyclictest27911-21chrt12:07:023
760999532,35cyclictest15247-21chrt09:04:323
760999524,35cyclictest13493-21chrt10:49:233
760999523,37cyclictest8154-21chrt08:44:113
760999523,36cyclictest9887-21chrt10:44:043
760999523,35cyclictest8330-21chrt11:34:293
760999523,35cyclictest8330-21chrt11:34:293
760999523,35cyclictest26533-21chrt07:59:323
760999523,35cyclictest20951-21chrt10:08:013
760999522,39cyclictest22041-21taskset09:14:573
760999522,39cyclictest22041-21taskset09:14:573
760999522,37cyclictest2666-21taskset10:30:433
760999522,37cyclictest2666-21taskset10:30:433
760999522,35cyclictest5143-21chrt11:29:263
760999522,33cyclictest959-21chrt09:34:313
760999522,33cyclictest31961-21chrt12:14:163
760999522,33cyclictest10154-21chrt08:49:293
760999514,33cyclictest22297-21taskset11:04:103
760999514,32cyclictest19106-21chrt07:34:453
760999513,35cyclictest30540-21chrt11:17:233
760999513,34cyclictest31264-21taskset08:14:303
760999513,33cyclictest25595-21chrt12:03:543
760999513,33cyclictest25595-21chrt12:03:543
760999513,33cyclictest12645-21taskset11:41:093
760999513,31cyclictest11687-21chrt08:54:233
760999504,33cyclictest5540-21taskset08:34:353
760999503,34cyclictest2450-21taskset11:24:323
760999503,33cyclictest29139-21chrt12:09:263
760999503,33cyclictest29139-21chrt12:09:263
760999503,32cyclictest32480-21chrt09:33:213
760999503,32cyclictest13458-21chrt07:19:433
760999503,32cyclictest13458-21chrt07:19:433
760999502,37cyclictest8345-21chrt09:46:223
760999502,37cyclictest8345-21chrt09:46:223
760999502,37cyclictest18152-21chrt11:49:533
760999502,37cyclictest18152-21chrt11:49:533
760999493,34cyclictest917-21kworker/3:1+events12:24:303
760999493,33cyclictest20064-21chrt07:39:313
760999492,34cyclictest15160-21taskset11:44:503
760999482,34cyclictest23278-21chrt07:49:313
760999482,34cyclictest11018-21chrt09:50:273
760999482,33cyclictest25189-21chrt11:09:083
760999482,33cyclictest19882-21chrt09:12:223
760999474,31cyclictest516-21chrt10:28:073
760999473,34cyclictest15009-21chrt09:58:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional