You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 17:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Fri May 01, 2026 12:43:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2418377995948,8cyclictest2547548-21wc11:05:032
2418376995345,3cyclictest0-21swapper/110:00:441
2418377995224,24cyclictest2475886-21sh09:35:452
2418377994940,4cyclictest0-21swapper/209:40:512
241837799493,24cyclictest2540827-21ssh10:55:512
241837799493,24cyclictest2540827-21ssh10:55:512
2418377994926,20cyclictest2455143-21cpu09:10:362
2418376994934,11cyclictest2580274-21if_wlan011:45:411
2418375994943,4cyclictest2591124-21systemd-run12:00:010
2418376994841,3cyclictest0-21swapper/112:35:451
2418375994841,5cyclictest12350irq/32-eth010:30:460
2418377994722,3cyclictest0-21swapper/211:15:492
241837799472,12cyclictest2500510-21ssh10:05:482
241837799471,18cyclictest2467870-21ssh09:25:462
2418375994729,13cyclictest2480088-21sh09:40:480
2418375994718,11cyclictest2471892-21ntpq09:30:460
2418377994638,5cyclictest2612325-21systemd-run12:30:012
2418377994620,4cyclictest1056-21mta-sts-daemon08:40:482
2418376994637,6cyclictest2499741-21aten_r2power_cu10:05:341
2418377994522,3cyclictest0-21swapper/211:11:002
2418375994537,5cyclictest2439399-21systemd-run08:20:010
2418375994537,5cyclictest2439399-21systemd-run08:20:010
2418375994531,10cyclictest2462510-21cron09:20:010
2418377994436,5cyclictest2536868-21mailstats10:50:502
2418377994421,3cyclictest0-21swapper/211:45:022
2418377994417,7cyclictest0-21swapper/209:50:432
2418377994417,6cyclictest2454385-21diskmemload09:30:402
2418376994436,5cyclictest1-21systemd11:25:011
2418376994435,5cyclictest2462524-21ls09:20:011
2418376994432,9cyclictest2448380-21latency_hist08:50:011
2418377994334,6cyclictest2425889-21systemd-run07:35:022
2418377994310,3cyclictest0-21swapper/212:20:382
2418376994334,6cyclictest2464606-21kworker/u8:8-nfsiod11:05:021
2418375994334,6cyclictest0-21swapper/008:45:020
2418375994333,5cyclictest151ktimers/007:50:460
2418375994326,14cyclictest2505912-21ssh10:12:190
2418377994217,3cyclictest0-21swapper/212:15:352
241837799421,20cyclictest2547720-21ssh11:05:052
2418376994235,3cyclictest0-21swapper/110:55:461
2418376994235,3cyclictest0-21swapper/110:55:461
2418375994231,8cyclictest2449898-21systemd-run08:55:010
2418375994215,22cyclictest0-21swapper/007:10:430
2418377994132,4cyclictest0-21swapper/211:55:502
241837799403,34cyclictest2584517-21ssh11:50:492
241837799403,28cyclictest2463830-21ssh09:20:462
241837799403,28cyclictest2463830-21ssh09:20:462
2418377994029,5cyclictest0-21swapper/210:45:452
2418376994031,6cyclictest420-21avahi-daemon09:20:371
2418376994031,6cyclictest420-21avahi-daemon09:20:371
2418376994031,6cyclictest2523372-21munin-plugin-st10:35:011
2418375994013,19cyclictest0-21swapper/008:05:490
2418375994011,23cyclictest2532711-21ssh10:45:490
2418377993931,3cyclictest0-21swapper/212:00:452
2418377993930,6cyclictest428-21mta-sts-daemon12:10:492
2418377993930,6cyclictest428-21mta-sts-daemon12:10:492
2418376993931,5cyclictest2551446-21cron11:10:011
2418376993929,5cyclictest0-21swapper/110:25:471
2418375993931,5cyclictest2454413-21sh09:10:010
2418375993927,9cyclictest2464606-21kworker/u8:8-rpciod11:05:020
241837799384,30cyclictest2528596-21ssh10:40:472
2418377993830,4cyclictest2515310-21basename10:25:002
2418377993828,4cyclictest0-21swapper/207:50:012
2418376993832,3cyclictest0-21swapper/109:40:011
2418376993829,6cyclictest1606395-21cups-browsed10:50:541
2418376993828,7cyclictest2443890-21/usr/sbin/munin08:35:021
241837699382,27cyclictest2528608-21ssh10:40:481
2418375993831,4cyclictest2587197-21systemd-run11:55:010
241837599382,29cyclictest2476057-21ssh09:35:510
2418375993813,9cyclictest2593890-21sh12:02:450
2418377993728,6cyclictest2567417-21systemd-run11:30:012
2418377993728,5cyclictest2580823-21sendmail_mailqu11:45:542
2418377993727,5cyclictest2504841-21mailstats10:10:552
241837699376,24cyclictest2524575-21sh10:35:471
2418376993729,5cyclictest2451363-21cron09:00:011
2418376993727,6cyclictest420-21avahi-daemon09:49:071
2418376993727,6cyclictest420-21avahi-daemon09:49:071
2418376993726,7cyclictest420-21avahi-daemon12:07:121
241837699372,31cyclictest2576680-21ssh11:40:481
241837599378,10cyclictest2616510-21ntp_states12:35:470
2418375993724,8cyclictest2564622-21ntpq11:25:430
2418375993724,7cyclictest2440297-21ntpq08:20:470
241837599372,29cyclictest2556648-21ssh11:15:460
2418375993713,6cyclictest0-21swapper/012:25:180
2418375993712,20cyclictest2548668-21ssh11:05:430
2418377993629,4cyclictest0-21swapper/210:20:012
2418377993629,3cyclictest0-21swapper/208:40:012
2418377993628,5cyclictest261-21systemd-journal08:35:012
2418377993627,6cyclictest2495104-21ssh10:00:012
241837799362,26cyclictest2496295-21ssh10:00:432
2418376993631,2cyclictest0-21swapper/107:25:011
2418376993628,5cyclictest2414348-21kworker/u8:11+xprtiod08:15:001
2418376993627,6cyclictest2431873-21systemd-run07:55:011
2418376993627,5cyclictest0-21swapper/108:00:471
2418376993626,6cyclictest1606395-21cups-browsed11:36:001
2418376993626,5cyclictest0-21swapper/109:51:411
241837699362,25cyclictest2607173-21sh12:20:481
2418375993626,7cyclictest1606395-21cups-browsed10:55:510
2418375993626,7cyclictest1606395-21cups-browsed10:55:510
2418375993622,8cyclictest2607119-21ntpq12:20:450
2418375993621,9cyclictest2450841-21ntpq08:55:490
2418375993621,12cyclictest2527710-21ssh10:40:120
2418375993620,13cyclictest2602125-21ssh12:14:160
2418375993620,13cyclictest2602125-21ssh12:14:160
2418375993619,14cyclictest2493199-21ssh09:56:300
2418375993617,8cyclictest2497424-21ssh10:01:420
2418375993613,7cyclictest2560637-21ntpq11:20:440
2418375993613,7cyclictest2489741-21sh09:52:390
2418375993611,7cyclictest2517318-21sh10:26:060
2418377993527,5cyclictest2525250-21unixbench_singl10:36:012
241837799352,27cyclictest2484211-21sh09:45:512
241837799352,27cyclictest2484211-21sh09:45:512
241837699353,24cyclictest2492216-21ssh09:55:431
241837699353,19cyclictest2467784-21ssh09:25:431
2418376993528,4cyclictest0-21swapper/111:15:471
2418376993527,5cyclictest2592357-21ntp_kernel_pll_12:00:461
2418376993527,5cyclictest2441429-21fschecks_time08:25:381
2418376993527,3cyclictest0-21swapper/111:55:011
2418376993525,7cyclictest2445379-21cron08:40:011
2418376993523,9cyclictest1606395-21cups-browsed11:11:531
241837699351,28cyclictest547-21gmain08:20:431
2418375993528,4cyclictest2615340-21cron12:35:000
2418375993522,8cyclictest2576612-21ntpq11:40:450
2418375993522,8cyclictest2434226-21ntpq08:00:430
2418375993522,8cyclictest2429798-21ntpq07:45:480
2418375993521,8cyclictest2437246-21ntpq08:10:460
2418375993518,14cyclictest2509768-21ssh10:17:050
2418375993517,16cyclictest2466966-21ssh09:25:220
2418375993516,7cyclictest2514540-21ssh10:23:310
2418377993425,6cyclictest2439908-21fschecks_time08:20:382
2418377993425,5cyclictest2614007-21tail12:30:562
241837799342,26cyclictest2459877-21ssh09:15:522
2418376993426,5cyclictest548-21gdbus09:00:541
2418376993425,6cyclictest548-21gdbus10:11:331
2418376993425,6cyclictest0-21swapper/112:15:541
2418376993422,7cyclictest2567896-21basename11:30:321
241837699342,25cyclictest2471895-21rm09:30:471
2418375993428,3cyclictest0-21swapper/009:45:490
2418375993428,3cyclictest0-21swapper/009:45:490
2418375993424,4cyclictest2552695-21ntpq11:10:480
2418375993423,6cyclictest2500410-21ntpq10:05:440
2418375993421,8cyclictest2452264-21ntpq09:00:450
2418375993418,10cyclictest2432871-21ps07:55:490
2418375993417,6cyclictest2574214-21ssh11:37:470
2418375993417,15cyclictest2454838-21ssh09:10:260
2418375993412,13cyclictest2463749-21ssh09:20:430
2418375993412,13cyclictest2463749-21ssh09:20:430
241837799333,25cyclictest2516551-21sh10:25:452
2418377993328,2cyclictest0-21swapper/212:10:012
2418377993328,2cyclictest0-21swapper/207:20:012
2418377993328,2cyclictest0-21swapper/207:20:012
2418377993324,6cyclictest421-21dbus-daemon11:40:012
2418377993315,15cyclictest351ktimers/209:05:472
241837699336,23cyclictest2600010-21ssh12:10:471
241837699336,23cyclictest2600010-21ssh12:10:471
2418376993327,3cyclictest0-21swapper/108:10:011
2418376993324,6cyclictest2609886-21aten_r2power_po12:25:361
241837699332,25cyclictest2455659-21ssh09:10:461
2418375993325,5cyclictest2424391-21systemd-run07:30:020
2418375993323,6cyclictest2580644-21ntpq11:45:480
2418375993321,8cyclictest2426809-21ntpq07:35:460
2418375993320,8cyclictest2425219-21ntpq07:30:430
2418375993319,10cyclictest2538509-21ssh10:53:160
2418375993318,11cyclictest2597180-21ssh12:06:400
241837599331,28cyclictest2524662-21ssh10:35:500
2418377993217,11cyclictest351ktimers/207:35:482
2418376993226,3cyclictest0-21swapper/107:25:451
2418376993222,8cyclictest2430045-21switchtime07:45:561
2418375993221,7cyclictest2443365-21ntpq08:30:480
2418375993221,7cyclictest2420706-21ntpq07:15:440
2418375993221,7cyclictest2420706-21ntpq07:15:440
2418375993220,9cyclictest2444813-21ntpq08:35:470
2418375993220,7cyclictest2447857-21ntpq08:45:500
2418375993216,6cyclictest2571289-21ssh11:34:510
2418377993124,4cyclictest0-21swapper/207:25:002
2418377993123,5cyclictest261-21systemd-journal08:10:002
2418377993121,6cyclictest0-21swapper/211:20:432
241837699317,5cyclictest2454385-21diskmemload12:30:441
2418376993125,3cyclictest0-21swapper/112:00:011
2418376993124,3cyclictest0-21swapper/110:47:581
2418376993122,4cyclictest0-21swapper/111:25:051
2418375993121,6cyclictest2428238-21ntpq07:40:440
2418375993120,7cyclictest2422295-21ntpq07:20:450
2418375993119,5cyclictest2603693-21ntpq12:15:470
241837799305,18cyclictest2616602-21grep12:35:502
2418377993023,4cyclictest2428867-21latency_hist07:45:012
2418377993023,4cyclictest1056-21mta-sts-daemon11:30:072
2418377993021,6cyclictest2452882-21cron09:05:012
2418377993019,8cyclictest2450688-21needreboot08:55:422
2418376993024,3cyclictest0-21swapper/108:00:011
2418376993023,4cyclictest2428439-21sendmail_mailqu07:40:511
2418376993021,6cyclictest2513255-21sh10:21:011
2418376993021,6cyclictest2454411-21systemd-run09:10:011
2418376993017,8cyclictest421-21dbus-daemon07:10:021
2418377992923,3cyclictest0-21swapper/210:30:322
2418377992920,6cyclictest420-21avahi-daemon08:15:532
2418377992920,6cyclictest420-21avahi-daemon08:15:532
241837699296,18cyclictest2480103-21ssh09:40:491
2418376992921,5cyclictest2507919-21head10:15:361
2418375992919,7cyclictest2441791-21ntpq08:25:450
2418377992822,4cyclictest2413071-21kworker/u8:7-rpciod08:00:012
2418377992820,5cyclictest439-21systemd-logind07:30:012
2418376992822,3cyclictest0-21swapper/108:45:011
2418377992721,3cyclictest1051-21mta-sts-daemon07:10:102
2418377992721,3cyclictest0-21swapper/208:50:012
2418377992721,3cyclictest0-21swapper/208:15:002
2418376992722,3cyclictest0-21swapper/108:55:011
2418376992718,6cyclictest2419803-21unixbench_singl07:10:561
2418376992620,3cyclictest2424384-21kworker/u8:2-xprtiod07:35:011
2418377992518,4cyclictest2449868-21cron08:55:012
2418377992517,5cyclictest1606395-21cups-browsed07:50:072
2418375992515,7cyclictest2418332-21munin-run07:10:010
2418377992417,4cyclictest1055-21mta-sts-daemon08:00:352
2418376992418,3cyclictest0-21swapper/107:20:011
2418376992418,3cyclictest0-21swapper/107:20:011
2418376992416,5cyclictest2438392-21fschecks_time08:15:391
2418376992416,5cyclictest2438392-21fschecks_time08:15:391
2418377992314,6cyclictest2441813-21grep08:25:452
241837699232,16cyclictest2426792-21ntpq07:35:451
241837899204,10cyclictest0-21swapper/311:05:023
2418377992010,7cyclictest2418329-21munin-plugin-st07:10:022
241837899196,8cyclictest0-21swapper/309:40:513
241837899194,6cyclictest0-21swapper/308:45:483
241837899193,7cyclictest0-21swapper/310:15:513
241837899193,7cyclictest0-21swapper/308:10:453
241837899193,10cyclictest0-21swapper/311:40:483
241837899191,9cyclictest0-21swapper/310:45:463
241837899184,9cyclictest0-21swapper/309:45:493
241837899184,9cyclictest0-21swapper/309:45:493
241837899183,9cyclictest0-21swapper/310:05:473
241837899183,8cyclictest0-21swapper/310:40:533
241837899183,8cyclictest0-21swapper/309:35:443
241837899182,11cyclictest0-21swapper/309:15:403
241837899182,10cyclictest0-21swapper/311:50:493
241837899182,10cyclictest0-21swapper/310:00:443
241837899174,8cyclictest0-21swapper/312:10:473
241837899174,8cyclictest0-21swapper/312:10:473
241837899173,9cyclictest0-21swapper/312:35:423
241837899173,9cyclictest0-21swapper/309:30:483
241837899173,8cyclictest0-21swapper/311:55:443
241837899173,8cyclictest0-21swapper/311:05:053
241837899172,9cyclictest0-21swapper/309:20:433
241837899172,9cyclictest0-21swapper/309:20:433
241837899172,8cyclictest0-21swapper/311:10:503
241837899172,8cyclictest0-21swapper/310:20:453
241837899172,10cyclictest0-21swapper/311:30:433
241837899171,9cyclictest0-21swapper/312:00:443
241837899171,9cyclictest0-21swapper/311:45:453
241837899171,9cyclictest0-21swapper/310:55:483
241837899171,9cyclictest0-21swapper/310:55:483
241837899171,9cyclictest0-21swapper/310:50:443
241837899171,8cyclictest0-21swapper/311:25:433
241837899164,8cyclictest0-21swapper/309:50:473
241837899163,9cyclictest0-21swapper/311:15:473
241837899163,8cyclictest0-21swapper/312:20:483
241837899163,7cyclictest0-21swapper/308:40:013
241837899162,9cyclictest0-21swapper/310:35:523
241837899162,9cyclictest0-21swapper/309:55:423
241837899162,8cyclictest0-21swapper/309:25:453
241837899162,8cyclictest0-21swapper/309:10:443
241837899162,8cyclictest0-21swapper/308:00:473
241837899162,8cyclictest0-21swapper/307:20:023
241837899162,8cyclictest0-21swapper/307:20:023
241837899162,7cyclictest0-21swapper/312:15:443
241837899162,7cyclictest0-21swapper/311:35:433
241837899162,7cyclictest0-21swapper/308:15:473
241837899162,7cyclictest0-21swapper/308:15:473
241837899162,7cyclictest0-21swapper/307:40:443
241837899161,9cyclictest0-21swapper/310:10:443
241837899154,6cyclictest0-21swapper/310:25:453
241837899153,8cyclictest0-21swapper/312:05:353
241837899153,8cyclictest0-21swapper/310:30:473
241837899152,8cyclictest0-21swapper/311:20:443
241837899151,8cyclictest0-21swapper/307:50:493
241837899151,8cyclictest0-21swapper/307:45:463
241837899151,7cyclictest0-21swapper/309:05:473
241837899143,8cyclictest0-21swapper/312:25:343
241837899143,5cyclictest0-21swapper/307:10:453
241837899142,8cyclictest0-21swapper/307:55:423
241837899142,7cyclictest0-21swapper/312:30:433
241837899141,7cyclictest0-21swapper/309:00:463
241837899141,7cyclictest0-21swapper/308:55:453
241837899141,7cyclictest0-21swapper/308:05:503
241837899141,7cyclictest0-21swapper/307:20:483
241837899133,6cyclictest0-21swapper/307:40:013
241837899133,5cyclictest0-21swapper/308:30:443
241837899132,7cyclictest0-21swapper/307:10:023
241837899131,6cyclictest0-21swapper/307:25:443
241837899122,6cyclictest0-21swapper/308:40:473
241837899122,5cyclictest0-21swapper/308:20:433
241837899121,6cyclictest0-21swapper/308:25:453
241837899111,7cyclictest0-21swapper/307:30:463
241837899101,6cyclictest0-21swapper/308:50:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional