You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 12:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Mon Jul 20, 2026 00:43:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2464221995034,12cyclictest443-21gpm22:05:442
2464221994939,7cyclictest2551603-21munin-plugin-st22:35:012
2464220994841,4cyclictest2527517-21cron21:55:011
2464221994640,3cyclictest2485173-21kworker/u8:6-rpciod21:10:402
2464221994635,7cyclictest724506-21cups-browsed22:30:012
246422099462,35cyclictest2591834-21ssh23:40:451
2464220994623,20cyclictest2517040-21timerwakeupswit21:35:571
2464220994622,21cyclictest2533571-21idleruntime-cro22:05:011
2464220994620,22cyclictest2615253-21sh00:20:341
2464221994536,5cyclictest0-21swapper/200:35:002
2464221994536,5cyclictest0-21swapper/200:35:002
246422099452,37cyclictest2582832-21ntpq23:25:441
246422099452,37cyclictest2582832-21ntpq23:25:441
2464220994520,22cyclictest0-21swapper/122:20:471
2464219994541,2cyclictest0-21swapper/000:35:380
2464219994533,7cyclictest151ktimers/021:05:440
2464219994530,11cyclictest12650irq/32-eth023:03:540
246422099441,38cyclictest2496647-21ntpq20:55:481
246422099441,37cyclictest2489157-21ntpq20:30:471
2464219994437,5cyclictest2608809-21/usr/sbin/munin00:10:020
2464219994437,5cyclictest2608809-21/usr/sbin/munin00:10:020
2464221994335,5cyclictest2620745-21munin-plugin-st00:30:012
2464221994335,5cyclictest2620745-21munin-plugin-st00:30:012
2464221994335,3cyclictest0-21swapper/220:45:432
2464221994335,3cyclictest0-21swapper/220:45:432
2464220994334,6cyclictest1-21systemd00:30:021
2464220994334,6cyclictest1-21systemd00:30:021
2464220994333,6cyclictest2482227-21systemd-run20:10:021
2464220994320,20cyclictest0-21swapper/123:10:011
246422099431,9cyclictest2466625-21ntpq19:15:461
2464221994229,9cyclictest420-21avahi-daemon23:55:042
246422099422,35cyclictest2522728-21ntpq21:45:481
2464220994219,19cyclictest0-21swapper/119:40:011
246422099421,35cyclictest2493619-21ntpq20:45:421
246422099421,35cyclictest2493619-21ntpq20:45:421
2464219994233,3cyclictest0-21swapper/019:30:510
2464219994230,9cyclictest151ktimers/022:40:420
2464221994134,4cyclictest0-21swapper/220:15:482
246422199413,28cyclictest2555768-21ssh22:40:462
2464221994132,5cyclictest2599751-21munin-plugin-st23:55:012
2464220994134,4cyclictest2563621-21cron22:55:001
246422099412,35cyclictest2480067-21ntpq20:00:411
246422099412,33cyclictest2492118-21ntpq20:40:441
246422099412,33cyclictest2487594-21ntpq20:25:421
246422099412,33cyclictest2483070-21ntpq20:10:431
246422099412,33cyclictest2465122-21ntpq19:10:451
246422099412,30cyclictest2468109-21ntpq19:20:451
246422099411,9cyclictest2519640-21ntpq21:40:451
246422099411,35cyclictest2576823-21ntpq23:15:441
246422099411,35cyclictest2477097-21ntpq19:50:441
246422099411,34cyclictest2513543-21ntpq21:30:511
246422099410,13cyclictest2550471-21ssh22:31:231
246421999414,30cyclictest2501326-21ssh21:10:450
2464219994130,8cyclictest2613437-21unixbench_singl00:15:570
2464219994130,8cyclictest2496502-21needreboot20:55:420
2464219994130,8cyclictest0-21swapper/000:20:420
2464219994126,6cyclictest2548721-21latency_hist22:30:020
246422199403,25cyclictest2615936-21ssh00:20:532
2464221994031,5cyclictest2528256-21idleruntime21:55:382
2464221994029,4cyclictest0-21swapper/222:55:432
246422099402,33cyclictest2588882-21ntpq23:35:491
246422099402,32cyclictest2471121-21ntpq19:30:471
246422099402,32cyclictest2469594-21ntpq19:25:471
246422099401,8cyclictest2510607-21ntpq21:25:481
246422099401,4cyclictest2474139-21ntpq19:40:461
246422099401,35cyclictest2552747-21ntpq22:35:461
246422099401,34cyclictest2600799-21ntpq23:55:411
246422099401,34cyclictest2579854-21ntpq23:20:451
246422099401,34cyclictest2484621-21ntpq20:15:461
246422099401,10cyclictest2567323-21df_inode23:00:371
2464219994032,5cyclictest2599746-21cron23:55:010
246421999402,32cyclictest2609909-21ssh00:10:500
246421999402,31cyclictest2528628-21ssh21:55:450
2464221993929,7cyclictest1002-21mta-sts-daemon22:04:252
2464221993928,7cyclictest0-21swapper/221:35:512
246422099393,30cyclictest2624915-21ntpq00:35:471
2464220993930,5cyclictest2528232-21fschecks_time21:55:381
246422099392,34cyclictest2609975-21ntpq00:10:531
246422099392,32cyclictest2501368-21sh21:10:471
246422099392,31cyclictest2594800-21ntpq23:45:431
246422099391,9cyclictest2546710-21ntpq22:25:441
246422099391,4cyclictest2621785-21ntpq00:30:411
246422099391,4cyclictest2621785-21ntpq00:30:411
246422099391,34cyclictest2478574-21ntpq19:55:451
246422099391,33cyclictest2486134-21ntpq20:20:451
2464219993929,2cyclictest0-21swapper/022:20:010
2464219993928,8cyclictest2558772-21grep22:45:470
2464219993928,8cyclictest2558772-21grep22:45:470
2464221993831,4cyclictest1002-21mta-sts-daemon21:33:542
2464221993831,3cyclictest0-21swapper/223:45:512
2464221993830,5cyclictest2591293-21/usr/sbin/munin23:40:352
2464221993829,6cyclictest2486712-21cron20:25:012
2464221993828,5cyclictest2560622-21sh22:50:002
2464221993828,5cyclictest2560622-21sh22:50:002
2464221993826,9cyclictest2543604-21needreboot22:20:412
2464221993824,10cyclictest2519444-21missed_timers21:40:392
246422099387,28cyclictest1002-21mta-sts-daemon00:05:541
246422099387,28cyclictest1002-21mta-sts-daemon00:05:541
246422099384,28cyclictest2603910-21ssh00:00:501
246422099382,32cyclictest2612960-21ntpq00:15:491
246422099381,8cyclictest2499551-21ntpq21:05:421
246422099381,6cyclictest2537759-21ntpq22:10:471
246422099381,5cyclictest2507452-21ntpq21:20:511
246422099381,5cyclictest2507452-21ntpq21:20:511
246422099381,4cyclictest2573758-21ntpq23:10:421
246422099381,4cyclictest2498094-21ntpq21:00:471
246422099381,32cyclictest2475568-21ntpq19:45:401
246422099380,12cyclictest2563865-21ssh22:55:031
2464219993831,4cyclictest2563632-21munin-plugin-st22:55:000
2464219993828,7cyclictest2573396-21fschecks_count23:10:360
2464221993731,3cyclictest0-21swapper/220:05:002
2464221993729,5cyclictest2538172-21unixbench-2d22:10:542
2464221993727,7cyclictest2487206-21/usr/sbin/munin20:25:342
2464221993726,8cyclictest2606716-21latency00:05:462
2464221993726,8cyclictest2606716-21latency00:05:462
2464221993726,7cyclictest420-21avahi-daemon22:37:342
2464221993726,7cyclictest420-21avahi-daemon21:17:522
2464221993726,7cyclictest420-21avahi-daemon21:17:522
246422199372,28cyclictest2561759-21ssh22:50:452
246422099372,31cyclictest2597846-21ntpq23:50:431
246422099372,30cyclictest2540762-21ntpq22:15:481
246422099371,7cyclictest2558091-21aten_r2power_fr22:45:331
246422099371,7cyclictest2558091-21aten_r2power_fr22:45:331
246422099371,4cyclictest2585788-21ntpq23:30:421
246422099371,4cyclictest2585788-21ntpq23:30:421
246422099371,31cyclictest2495058-21ntpq20:50:421
246422099371,11cyclictest2490648-21ntp_states20:35:471
246422099371,10cyclictest2555822-21ntpq22:40:491
2464219993731,4cyclictest2473192-21cron19:40:010
2464219993726,8cyclictest2553282-21unixbench_singl22:35:560
2464221993623,10cyclictest2483008-21needreboot20:10:412
246422099361,5cyclictest2534664-21ntpq22:05:451
246422099361,4cyclictest2504431-21ntpq21:15:481
246422099361,4cyclictest2504431-21ntpq21:15:481
2464219993627,3cyclictest0-21swapper/021:29:160
2464219993617,15cyclictest2516590-21ssh21:35:470
246422199353,25cyclictest2579996-21grep23:20:512
2464221993529,3cyclictest0-21swapper/220:45:012
2464221993528,4cyclictest2464226-21kthreadd19:10:012
2464221993528,4cyclictest2464226-21kthreadd19:10:012
2464221993523,9cyclictest2475605-21ntp_kernel_pll_19:45:422
246422199352,25cyclictest2540636-21ssh22:15:432
2464219993529,4cyclictest2577367-21tail23:15:550
2464219993529,4cyclictest2464319-21latency_hist19:10:020
2464219993529,4cyclictest2464319-21latency_hist19:10:020
2464219993528,5cyclictest2588165-21aten_r2power_cu23:35:320
2464219993528,4cyclictest2465925-21/usr/sbin/munin19:15:370
246421999352,28cyclictest665-21snmpd20:00:470
246421999352,28cyclictest2603951-21ssh00:00:510
2464221993425,6cyclictest2491195-21munin-plugin-st20:40:012
246421999344,23cyclictest2525602-21ssh21:50:430
2464219993426,5cyclictest421-21dbus-daemon21:40:050
2464219993423,8cyclictest2618936-21sh00:25:490
2464219993423,8cyclictest2618936-21sh00:25:490
246421999342,28cyclictest2531737-21ssh22:00:460
2464221993326,3cyclictest0-21swapper/200:20:012
2464221993325,5cyclictest0-21swapper/219:40:012
2464221993323,7cyclictest0-21swapper/223:35:002
2464221993323,7cyclictest0-21swapper/223:35:002
246422199332,19cyclictest2573797-21ssh23:10:442
2464221993321,7cyclictest0-21swapper/221:46:212
2464221993321,7cyclictest0-21swapper/221:20:512
2464221993321,7cyclictest0-21swapper/221:20:512
2464221993315,11cyclictest2576740-21/usr/sbin/munin23:15:412
2464219993326,4cyclictest2488205-21cron20:30:010
2464219993326,4cyclictest2482207-21munin-plugin-st20:10:010
2464219993324,5cyclictest0-21swapper/021:30:570
2464219993323,8cyclictest2566635-21munin-run23:00:000
2464219993317,13cyclictest1-21systemd00:35:010
2464219993317,13cyclictest1-21systemd00:35:010
2464219993316,10cyclictest724506-21cups-browsed19:55:470
2464221993226,3cyclictest0-21swapper/219:50:542
2464221993225,3cyclictest0-21swapper/223:35:462
2464221993224,5cyclictest2479000-21timerwakeupswit19:55:552
2464221993224,3cyclictest0-21swapper/200:35:432
2464221993223,4cyclictest0-21swapper/221:00:012
246422199322,22cyclictest2609843-21ssh00:10:462
2464219993226,3cyclictest1003-21mta-sts-daemon23:30:470
2464219993226,3cyclictest1003-21mta-sts-daemon23:30:470
2464219993225,4cyclictest2509408-21idleruntime-cro21:25:000
2464219993225,4cyclictest2509408-21idleruntime-cro21:25:000
2464219993224,6cyclictest2470211-21/usr/sbin/munin19:30:020
2464219993223,6cyclictest2545725-21sort22:25:020
246422199312,8cyclictest171rcu_preempt21:25:462
2464221993124,4cyclictest2499757-21processes21:05:502
2464221993123,5cyclictest2464736-21fschecks_time19:10:372
2464221993123,4cyclictest0-21swapper/223:25:462
2464221993123,4cyclictest0-21swapper/223:25:462
2464221993117,9cyclictest0-21swapper/223:00:402
2464219993126,2cyclictest0-21swapper/023:22:430
2464219993123,5cyclictest2476219-21systemd-run19:50:010
246421999312,23cyclictest665-21snmpd23:25:430
246421999312,23cyclictest665-21snmpd23:25:430
2464219993121,6cyclictest1000-21mta-sts-daemon21:49:090
2464219993116,10cyclictest12650irq/32-eth023:55:480
2464219993115,10cyclictest12650irq/32-eth020:40:440
246421999311,23cyclictest2591939-21ssh23:40:490
2464221993024,3cyclictest0-21swapper/219:30:012
2464221993022,5cyclictest2527517-21cron21:55:012
2464221993022,3cyclictest0-21swapper/200:00:362
2464219993025,3cyclictest2537193-21cpuspeed22:10:330
2464219993023,5cyclictest0-21swapper/023:45:330
246422199295,19cyclictest1003-21mta-sts-daemon19:20:512
2464221992920,5cyclictest2471704-21sh19:35:012
246422099291,25cyclictest265-21systemd-journal19:10:011
246422099291,25cyclictest265-21systemd-journal19:10:011
246421999292,20cyclictest2534721-21ssh22:05:480
2464221992820,5cyclictest2467196-21cron19:20:002
2464221992820,4cyclictest0-21swapper/220:50:552
2464221992819,7cyclictest2489379-21switchtime20:30:542
246422199281,16cyclictest2571431-21users23:05:572
2464219992822,3cyclictest0-21swapper/023:05:440
246421999282,19cyclictest665-21snmpd19:50:450
2464219992821,5cyclictest2465892-21latency_hist19:15:020
2464219992819,7cyclictest2473475-21aten_r2power_cu19:40:330
2464219992819,6cyclictest2506497-21latency_hist21:20:030
2464219992819,6cyclictest2506497-21latency_hist21:20:030
2464221992720,4cyclictest2482109-21unixbench_multi20:06:002
246421999272,16cyclictest12650irq/32-eth022:30:440
2464219992712,2cyclictest0-21swapper/020:10:430
2464221992619,3cyclictest0-21swapper/221:00:452
246421999262,20cyclictest2498671-21bash21:01:010
2464219992620,4cyclictest724506-21cups-browsed20:45:320
2464219992620,4cyclictest724506-21cups-browsed20:45:320
2464219992619,5cyclictest2491286-21latency_hist20:40:020
2464219992619,4cyclictest0-21swapper/020:20:010
2464219992410,11cyclictest2489694-21cron20:35:010
2464221992315,4cyclictest0-21swapper/219:40:422
2464219992318,3cyclictest2465692-21kworker/u8:5-xprtiod19:20:370
2464219992217,3cyclictest1001-21mta-sts-daemon20:54:090
246421999219,8cyclictest2486349-21/usr/sbin/munin20:20:520
246422299203,8cyclictest0-21swapper/321:35:483
246422299202,8cyclictest0-21swapper/321:15:453
246422299202,8cyclictest0-21swapper/321:15:453
246422299193,7cyclictest0-21swapper/300:10:463
246422299192,9cyclictest0-21swapper/323:55:463
246422299183,8cyclictest0-21swapper/322:20:443
246422299183,8cyclictest0-21swapper/322:10:453
246422299183,8cyclictest0-21swapper/300:20:493
246422299173,8cyclictest0-21swapper/323:15:423
246422299173,7cyclictest0-21swapper/323:03:543
246422299173,7cyclictest0-21swapper/321:40:413
246422299173,6cyclictest0-21swapper/323:25:433
246422299173,6cyclictest0-21swapper/323:25:433
246422299172,9cyclictest0-21swapper/322:55:383
246422299172,8cyclictest0-21swapper/323:10:453
246422299162,9cyclictest0-21swapper/322:30:573
246422299162,7cyclictest0-21swapper/320:40:453
246422299160,9cyclictest0-21swapper/323:45:433
246422299152,8cyclictest0-21swapper/323:20:493
246422299152,8cyclictest0-21swapper/321:25:463
246422299152,7cyclictest0-21swapper/323:35:483
246422299152,7cyclictest0-21swapper/323:30:433
246422299152,7cyclictest0-21swapper/323:30:433
246422299152,6cyclictest0-21swapper/321:45:343
246422299152,6cyclictest0-21swapper/319:50:413
246422299152,5cyclictest0-21swapper/321:05:433
246422299151,8cyclictest0-21swapper/321:20:513
246422299151,8cyclictest0-21swapper/321:20:513
246422299151,7cyclictest0-21swapper/321:30:413
246422299151,6cyclictest0-21swapper/320:10:433
246422299144,6cyclictest0-21swapper/322:40:443
246422299143,7cyclictest0-21swapper/320:45:433
246422299143,7cyclictest0-21swapper/320:45:433
246422299142,8cyclictest0-21swapper/322:00:433
246422299142,7cyclictest0-21swapper/322:05:353
246422299141,9cyclictest0-21swapper/322:15:393
246422299141,8cyclictest0-21swapper/322:25:333
246422299141,8cyclictest0-21swapper/319:40:423
246422299141,8cyclictest0-21swapper/300:35:593
246422299141,7cyclictest0-21swapper/300:00:453
246422299136,4cyclictest0-21swapper/322:35:463
246422299135,6cyclictest0-21swapper/321:50:373
246422299134,6cyclictest0-21swapper/320:50:423
246422299133,7cyclictest0-21swapper/321:10:403
246422299133,7cyclictest0-21swapper/320:15:483
246422299133,6cyclictest0-21swapper/300:05:453
246422299133,6cyclictest0-21swapper/300:05:453
246422299133,4cyclictest0-21swapper/319:45:403
246422299132,8cyclictest0-21swapper/323:40:333
246422299132,7cyclictest0-21swapper/300:30:333
246422299132,7cyclictest0-21swapper/300:30:333
246422299132,7cyclictest0-21swapper/300:15:343
246422299131,8cyclictest0-21swapper/323:53:183
246422299131,6cyclictest0-21swapper/322:50:343
246422299131,6cyclictest0-21swapper/322:45:423
246422299131,6cyclictest0-21swapper/322:45:423
246422299131,6cyclictest0-21swapper/320:55:443
246422299131,6cyclictest0-21swapper/320:20:423
246422299125,4cyclictest0-21swapper/319:30:453
246422299124,4cyclictest0-21swapper/319:35:433
246422299122,7cyclictest0-21swapper/320:00:483
246422299122,6cyclictest0-21swapper/322:00:023
246422299122,5cyclictest0-21swapper/320:05:483
246422299121,8cyclictest0-21swapper/300:25:463
246422299121,8cyclictest0-21swapper/300:25:463
246422299121,7cyclictest0-21swapper/323:05:463
246422299112,5cyclictest0-21swapper/319:15:373
246422299111,6cyclictest0-21swapper/321:00:393
246422299111,6cyclictest0-21swapper/319:55:433
246422299111,6cyclictest0-21swapper/319:10:473
246422299102,6cyclictest0-21swapper/320:25:413
246422299102,5cyclictest0-21swapper/320:35:373
246422299101,6cyclictest0-21swapper/319:25:473
246422299101,5cyclictest0-21swapper/319:20:513
24642229992,5cyclictest0-21swapper/319:10:013
24642229992,5cyclictest0-21swapper/319:10:013
24642229991,5cyclictest0-21swapper/320:30:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional