You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 09:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Fri Jul 24, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5658212414,78sleep25706-21/usr/sbin/munin18:52:062
5658212414,78sleep25706-21/usr/sbin/munin18:52:062
64999911980,33cyclictest14072-21ssh22:46:231
6493991103,98cyclictest14091-21apt-get22:46:430
6499991052,50cyclictest22556-21ssh21:11:261
6499991013,45cyclictest5884-21runrttasks20:31:581
64999910040,8cyclictest0-21swapper/121:18:261
6499991003,36cyclictest28984-21fschecks_time21:21:461
64999910033,12cyclictest0-21swapper/120:12:001
649999983,38cyclictest9496-21unixbench_singl20:42:001
51032987,64sleep05151-21cstates18:51:430
51032987,64sleep05151-21cstates18:51:430
649999973,33cyclictest6500-21latency_hist18:56:281
649999973,33cyclictest6500-21latency_hist18:56:281
6499999728,17cyclictest0-21swapper/122:47:381
649399973,54cyclictest17495-21munin-run23:46:220
649999964,34cyclictest8265-21munin-node19:41:351
649999964,32cyclictest6277-21ssh22:31:581
6493999683,8cyclictest15350irq/295-2188000.ethernet23:21:520
649999953,38cyclictest15022-21latency_hist19:21:271
649999953,32cyclictest20100-21/usr/sbin/munin22:01:481
6499999446,41cyclictest0-21swapper/121:36:481
6499999446,41cyclictest0-21swapper/121:36:481
649999943,40cyclictest20488-21ssh23:51:231
649999943,40cyclictest20488-21ssh23:51:231
649999943,37cyclictest9636-21grep19:02:021
6493999467,19cyclictest13379-21latency_hist19:16:260
6502999374,13cyclictest19676-21snmpd20:01:252
649999934,38cyclictest11304-21latency_hist22:41:271
649999933,35cyclictest352-21runrttasks20:53:121
649999932,36cyclictest4465-21grep00:17:001
649999932,36cyclictest4465-21grep00:17:001
6502999250,35cyclictest0-21swapper/221:37:042
6502999250,35cyclictest0-21swapper/221:37:042
650299923,38cyclictest8798-21cut20:41:462
649999923,31cyclictest31681-21latency_hist22:21:271
649999923,31cyclictest31681-21latency_hist22:21:271
6493999263,19cyclictest29530-21latency_hist20:06:260
6493999263,19cyclictest29530-21latency_hist20:06:260
649999914,35cyclictest24094-21/usr/sbin/munin23:57:221
649999914,35cyclictest23233-21/usr/sbin/munin19:46:581
649999913,39cyclictest6674-21ssh00:21:461
649999913,39cyclictest6674-21ssh00:21:461
649999913,39cyclictest6674-21ssh00:21:461
649999913,38cyclictest25831-21grep19:52:011
649999913,34cyclictest3690-21/usr/sbin/munin20:26:351
6499999132,12cyclictest0-21swapper/121:16:261
6499999132,12cyclictest0-21swapper/121:16:261
649999912,35cyclictest21356-21latency_hist19:41:251
649999912,35cyclictest21356-21latency_hist19:41:251
649999912,31cyclictest17519-21/usr/sbin/munin22:51:451
649399913,68cyclictest19377-21apt21:06:230
649399913,68cyclictest19377-21apt21:06:230
649999903,40cyclictest20024-21latency_hist22:01:271
649999903,36cyclictest11729-21cat20:51:261
649999903,31cyclictest352-21runrttasks23:26:181
649999903,31cyclictest16891-21latency_hist21:56:411
649999902,35cyclictest13420-21grep19:16:261
6493999049,28cyclictest8432-21latency_hist20:41:270
6502998944,39cyclictest0-21swapper/200:08:422
649999896,41cyclictest29177-21kworker/u17:0+ext4-rsv-conversion23:17:401
649999893,39cyclictest31181-21latency_hist20:11:261
649999893,39cyclictest31181-21latency_hist20:11:261
649999893,35cyclictest486-21/usr/sbin/munin00:11:571
649999893,35cyclictest11477-21fschecks_count21:46:451
649999893,33cyclictest10346-21acpi19:06:361
649999893,28cyclictest15262-21cstates19:21:411
649999892,39cyclictest13993-21fschecks_time20:56:481
649999892,37cyclictest9967-21unixbench_singl23:32:001
6493998917,29cyclictest9345-21apt-get00:26:360
6502998853,24cyclictest11082-21grep20:47:002
650299883,40cyclictest12692-21diskmemload23:36:592
649999885,36cyclictest7841-21awk20:37:001
649999884,35cyclictest28778-21switchtime20:01:571
649999884,35cyclictest28778-21switchtime20:01:571
649999884,31cyclictest30324-21fschecks_time00:06:461
649999883,39cyclictest2260-21fschecks_count20:21:451
649999883,36cyclictest14790-21latency_hist23:41:271
649999882,35cyclictest16784-21/usr/sbin/munin19:26:551
649999882,35cyclictest16784-21/usr/sbin/munin19:26:551
649999882,29cyclictest29423-21/usr/sbin/munin23:11:541
6502998745,36cyclictest0-21swapper/222:56:462
650299873,37cyclictest12188-21/usr/sbin/munin20:52:402
650299872,60cyclictest14671-21apt-get22:46:432
649999874,33cyclictest28115-21unixbench_singl00:02:031
649999874,33cyclictest20494-21/usr/sbin/munin22:56:501
649999872,35cyclictest1808-21/usr/sbin/munin20:21:241
649999872,34cyclictest18389-21/usr/sbin/munin19:31:551
649999872,34cyclictest18389-21/usr/sbin/munin19:31:551
649999872,33cyclictest17750-21grep21:02:061
649999872,33cyclictest17750-21grep21:02:061
6502998640,38cyclictest0-21swapper/222:51:502
650299863,39cyclictest4275-21ssh23:22:502
650299863,38cyclictest26234-21unin-run19:56:252
649999864,36cyclictest8190-21/usr/sbin/munin21:41:581
649999863,37cyclictest21582-21cut23:52:541
649999863,37cyclictest21582-21cut23:52:541
649999863,36cyclictest303-21ssh22:21:571
649999863,35cyclictest27368-21unixbench_multi19:56:591
6502998567,10cyclictest11611-21idleruntime-cro23:36:232
650299854,38cyclictest352-21runrttasks22:31:272
6502998538,42cyclictest0-21swapper/222:16:472
6502998538,42cyclictest0-21swapper/222:16:472
650299853,23cyclictest16982-21apt-get21:56:352
650299852,37cyclictest30212-21ntp_kernel_pll_20:06:492
650299852,37cyclictest30212-21ntp_kernel_pll_20:06:492
650299852,34cyclictest6681-21taskset18:56:392
650299852,34cyclictest6681-21taskset18:56:392
650299852,26cyclictest31536-21runrttasks20:11:452
6499998559,20cyclictest25954-21sh22:11:271
649999853,31cyclictest32543-21switchtime21:27:011
649999852,37cyclictest26796-21fschecks_time23:06:461
6502998461,16cyclictest32408-21apt-key23:16:282
650299844,40cyclictest16784-21/usr/sbin/munin19:26:562
650299844,40cyclictest16784-21/usr/sbin/munin19:26:562
650299844,35cyclictest25758-21latency_hist22:11:262
6502998439,38cyclictest14311-21latency_hist22:46:262
650299843,38cyclictest15923-21grep23:42:012
6499998464,14cyclictest170-21jbd2/mmcblk2p2-821:31:511
649999843,35cyclictest6828-21diskstats18:56:431
649999843,35cyclictest6828-21diskstats18:56:431
649999843,34cyclictest14838-21/usr/sbin/munin23:41:471
649999842,35cyclictest5958-21/usr/sbin/munin23:26:421
649999842,35cyclictest5958-21/usr/sbin/munin23:26:421
649999842,34cyclictest2785-21fschecks_count22:26:451
649399843,71cyclictest8610-21apt23:31:230
649399843,71cyclictest8610-21apt23:31:230
650299836,31cyclictest10059-21modprobe19:06:232
650299834,35cyclictest22407-21grep23:53:202
650299834,35cyclictest22407-21grep23:53:202
650299834,34cyclictest20800-21ps22:01:592
650299834,33cyclictest58-21kcompactd022:41:262
650299834,32cyclictest3266-21latency_hist00:16:252
650299833,58cyclictest2610-21munin-plugin-st23:21:232
650299833,37cyclictest26617-21wc23:06:412
6493998342,30cyclictest0-21swapper/023:14:380
650299824,33cyclictest27074-21unixbench_multi22:12:002
650299824,32cyclictest8268-21latency_hist20:41:262
650299824,32cyclictest17807-21/usr/sbin/munin23:47:012
650299824,32cyclictest17807-21/usr/sbin/munin23:47:012
650299823,36cyclictest31969-21/usr/sbin/munin22:21:432
649999823,35cyclictest352-21runrttasks23:06:071
649999823,35cyclictest352-21runrttasks23:06:071
650299813,35cyclictest8190-21/usr/sbin/munin21:41:552
650299813,33cyclictest17831-21wc21:56:572
650299813,32cyclictest31727-21runrttasks21:26:382
650299812,36cyclictest5958-21/usr/sbin/munin23:26:552
650299812,36cyclictest5958-21/usr/sbin/munin23:26:552
6502998115,25cyclictest24345-21timerandwakeup23:01:582
6502998115,25cyclictest24345-21timerandwakeup23:01:582
6493998155,15cyclictest29042-21ssh21:21:470
650299809,66cyclictest0-21swapper/219:41:392
650299804,34cyclictest4325-21find20:26:572
650299804,34cyclictest24094-21/usr/sbin/munin23:57:282
650299804,33cyclictest2584-21ntp_kernel_pll_20:21:522
650299804,33cyclictest19696-21/usr/sbin/munin21:06:472
650299804,31cyclictest5473-21/usr/sbin/munin22:31:342
650299803,36cyclictest7374-21ls00:22:002
650299803,36cyclictest7374-21ls00:22:002
650299803,36cyclictest7374-21ls00:22:002
650299803,36cyclictest14356-21open_inodes20:56:582
650299803,34cyclictest28613-21/usr/sbin/munin20:01:542
650299803,34cyclictest28613-21/usr/sbin/munin20:01:542
650299803,33cyclictest26022-21fschecks_time21:16:462
650299803,33cyclictest23348-21cstates19:46:422
650299803,31cyclictest25560-21latency_hist21:16:272
650299803,31cyclictest25560-21latency_hist21:16:272
650299803,23cyclictest19085-21/usr/sbin/munin19:31:572
650299803,23cyclictest19085-21/usr/sbin/munin19:31:572
6493998037,34cyclictest0-21swapper/023:53:080
6493998037,34cyclictest0-21swapper/023:53:080
649399803,22cyclictest1-21systemd19:01:240
649399803,22cyclictest1-21systemd19:01:240
650299794,32cyclictest10805-21needreboot19:06:532
650299794,30cyclictest633-21fschecks_count20:16:432
650299794,24cyclictest3045-21switchtime21:32:002
650299793,35cyclictest15023-21latency_hist19:21:272
650299793,32cyclictest11204-21/usr/sbin/munin21:46:472
650299792,26cyclictest17148-21cat21:01:512
650299792,26cyclictest17148-21cat21:01:512
650299792,20cyclictest29678-21/usr/sbin/munin21:22:002
6493997944,21cyclictest0-21swapper/021:51:350
649399793,40cyclictest2353-21cstates21:31:410
6493997912,35cyclictest0-21swapper/021:49:200
650299783,36cyclictest13311-21modprobe19:16:242
650299783,34cyclictest3753-21fschecks_time00:16:452
650299783,34cyclictest3753-21fschecks_time00:16:452
650299783,31cyclictest5749-21latency20:31:522
650299783,30cyclictest21494-21latency_hist19:41:262
650299783,30cyclictest21494-21latency_hist19:41:262
650299783,25cyclictest27469-21/usr/sbin/munin00:01:512
649999783,34cyclictest26795-21mailstats22:11:571
649399783,56cyclictest24117-21apt-get23:56:380
649399783,39cyclictest10893-21latency_hist21:46:230
649399783,34cyclictest10072-21modprobe19:06:240
650299773,21cyclictest15317-21/usr/sbin/munin19:21:422
649399779,27cyclictest11690-21cat20:51:260
6493997753,16cyclictest18444-21sh23:46:540
6493997753,16cyclictest18444-21sh23:46:540
6493997753,14cyclictest0-21swapper/000:21:410
6493997753,14cyclictest0-21swapper/000:21:410
649399773,64cyclictest2604-21basename23:21:230
649399773,49cyclictest352-21runrttasks00:02:330
649399773,27cyclictest9815-21timerandwakeup23:31:580
6493997731,34cyclictest0-21swapper/021:16:270
6493997731,34cyclictest0-21swapper/021:16:270
649399772,64cyclictest11703-21awk19:11:240
6493997654,13cyclictest32743-21rm00:11:250
649399764,40cyclictest25673-21/usr/sbin/munin21:16:560
649399763,63cyclictest12020-21apt-get20:52:350
649399763,37cyclictest20791-21fschecks_time22:56:460
6493997618,12cyclictest8097-21ssh21:41:270
6493997555,10cyclictest19486-21kworker/u17:3+xprtiod22:06:420
650899749,37cyclictest0-21swapper/323:46:223
6493997416,49cyclictest21395-21grep19:41:250
6493997416,49cyclictest21395-21grep19:41:250
649399736,20cyclictest4606-21tail20:27:010
6493997356,10cyclictest13364-21diskmemload00:11:520
649399734,28cyclictest13680-21/usr/sbin/munin20:56:530
6493997341,23cyclictest8755-21cut20:41:460
649399733,56cyclictest14138-21modprobe22:46:230
649399733,31cyclictest8340-21latency_hist22:36:260
6493997318,38cyclictest17330-21expr21:56:410
6493997316,24cyclictest0-21swapper/021:26:580
6493997315,17cyclictest29663-21open_files22:16:560
6493997315,17cyclictest29663-21open_files22:16:560
649399726,24cyclictest13562-21apt-get19:16:340
649399723,49cyclictest5532-21fschecks_count20:31:480
6493997145,19cyclictest14653-21latency_hist23:41:260
649399713,36cyclictest26468-21/usr/sbin/munin23:06:450
649399713,35cyclictest29692-21/usr/sbin/munin20:06:470
649399713,35cyclictest29692-21/usr/sbin/munin20:06:470
649399713,35cyclictest2924-21sh22:26:490
6493997117,35cyclictest0-21swapper/019:42:000
649399704,32cyclictest32661-21/usr/sbin/munin20:16:240
6493996943,18cyclictest695-21ssh22:22:120
649399693,33cyclictest25314-21needreboot19:51:510
649399692,33cyclictest22969-21latency_hist22:06:270
6493996919,9cyclictest5258-21ssh21:36:410
6493996919,16cyclictest18886-21chrt19:31:510
6493996919,16cyclictest18886-21chrt19:31:510
6493996919,13cyclictest26704-21tune2fs19:56:450
6493996852,9cyclictest19192-21kworker/u17:1+xprtiod23:01:540
6493996852,9cyclictest19192-21kworker/u17:1+xprtiod23:01:540
6493996852,10cyclictest13364-21diskmemload21:08:060
6493996850,12cyclictest297-21systemd-logind19:31:250
6493996850,12cyclictest297-21systemd-logind19:31:250
536626810,38sleep30-21swapper/318:51:543
536626810,38sleep30-21swapper/318:51:543
649399673,44cyclictest2288-21cut20:21:450
649399673,42cyclictest1802-21sh20:21:230
649399672,33cyclictest352-21runrttasks22:40:240
6493996718,17cyclictest28800-21date22:16:250
649399663,45cyclictest23455-21fschecks_count19:46:460
649399663,34cyclictest17944-21irqstats22:51:490
649399659,23cyclictest15543-21cut19:21:490
649399654,30cyclictest352-21runrttasks00:21:000
649399654,30cyclictest352-21runrttasks00:21:000
6508996317,31cyclictest0-21swapper/322:47:373
650899605,35cyclictest0-21swapper/320:52:053
650899603,42cyclictest10230-21taskset19:06:273
650899594,35cyclictest409-21chrt00:11:263
650899592,42cyclictest32498-21chrt23:16:273
6508995641,10cyclictest451rcuc/322:01:443
650899563,41cyclictest19659-21taskset21:06:293
6508995540,10cyclictest451rcuc/320:06:343
6508995540,10cyclictest451rcuc/320:06:343
650899553,30cyclictest0-21swapper/323:57:013
6508995519,7cyclictest0-21swapper/323:51:333
6508995519,7cyclictest0-21swapper/323:51:333
6508995511,34cyclictest0-21swapper/323:26:233
650899543,39cyclictest31643-21taskset21:26:283
650899543,35cyclictest9238-21taskset00:26:303
650899543,35cyclictest9238-21taskset00:26:303
650899543,35cyclictest9238-21taskset00:26:303
650899543,32cyclictest31993-21taskset22:21:343
6508995411,34cyclictest0-21swapper/323:36:233
650899537,37cyclictest28983-21chrt23:11:003
6508995339,9cyclictest451rcuc/300:16:543
6508995339,9cyclictest451rcuc/300:16:543
650899533,38cyclictest26288-21taskset22:11:443
650899533,37cyclictest8691-21taskset22:36:463
6508995235,9cyclictest451rcuc/322:07:393
650899523,39cyclictest18325-21chrt22:51:593
650899523,39cyclictest14642-21taskset21:51:503
650899523,36cyclictest14326-21taskset20:56:563
650899523,35cyclictest12400-21taskset23:36:503
650899514,31cyclictest0-21swapper/319:11:253
6508995137,9cyclictest451rcuc/321:38:543
6508995137,9cyclictest451rcuc/321:38:543
6508995136,10cyclictest451rcuc/300:12:413
650899513,36cyclictest3500-21chrt22:27:013
650899513,35cyclictest8334-21taskset23:30:383
650899513,35cyclictest8334-21taskset23:30:383
650899513,35cyclictest21838-21chrt19:41:463
650899513,35cyclictest12020-21chrt22:41:533
650899513,27cyclictest0-21swapper/323:16:563
650899512,36cyclictest2751-21taskset21:31:513
650899512,36cyclictest13515-21taskset21:50:203
650899512,33cyclictest26622-21chrt21:16:593
6508995035,8cyclictest451rcuc/320:49:433
650899503,38cyclictest974-21chrt20:16:503
650899503,35cyclictest19134-21chrt21:59:323
650899503,34cyclictest19594-21taskset23:48:543
650899503,34cyclictest19594-21taskset23:48:543
650899502,39cyclictest7765-21chrt22:35:203
650899502,36cyclictest9172-21taskset21:42:013
650899502,34cyclictest29385-21chrt22:16:473
650899502,34cyclictest29385-21chrt22:16:473
650899493,32cyclictest8303-21chrt20:41:253
650899493,32cyclictest25903-21chrt23:05:453
650899493,32cyclictest25903-21chrt23:05:453
650899492,34cyclictest3548-21chrt20:26:263
650899492,32cyclictest32747-21chrt20:16:263
650899484,35cyclictest17747-21taskset19:27:003
650899484,35cyclictest17747-21taskset19:27:003
650899484,35cyclictest16857-21taskset21:01:433
650899484,35cyclictest16857-21taskset21:01:433
650899483,31cyclictest29720-21taskset00:06:233
650899483,31cyclictest25508-21chrt21:16:263
650899483,31cyclictest25508-21chrt21:16:263
650899482,33cyclictest6795-21chrt20:36:263
650899473,33cyclictest9844-21chrt20:46:103
6508994732,8cyclictest451rcuc/320:03:543
6508994732,8cyclictest451rcuc/320:03:543
6508994731,9cyclictest451rcuc/319:33:323
6508994731,9cyclictest451rcuc/319:33:323
650899463,29cyclictest24741-21chrt19:51:263
650899453,28cyclictest7114-21chrt18:56:513
650899453,28cyclictest7114-21chrt18:56:513
6508994531,9cyclictest451rcuc/319:56:463
650899452,33cyclictest3945-21chrt20:26:463
650899452,33cyclictest13579-21chrt19:16:393
650899443,27cyclictest21571-21chrt22:57:013
6508994327,11cyclictest451rcuc/319:36:533
6508994327,11cyclictest451rcuc/319:36:533
650899422,24cyclictest0-21swapper/319:56:253
650899413,28cyclictest15424-21taskset19:21:463
6508994126,9cyclictest451rcuc/319:12:263
650899392,24cyclictest28653-21taskset21:21:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional