You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 19:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Fri May 22, 2026 12:43:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2301794995636,15cyclictest0-21swapper/110:46:001
2301794995636,15cyclictest0-21swapper/110:46:001
2301794995626,4cyclictest0-21swapper/110:01:001
230179399552,44cyclictest12350irq/32-eth011:36:010
2301795995342,6cyclictest2491524-21sh12:20:572
2301793995230,16cyclictest12450irq/33-eth010:25:560
230179499513,25cyclictest2499595-21ssh12:31:001
2301794995124,4cyclictest0-21swapper/112:21:011
2301793995131,17cyclictest1056-21mta-sts-daemon09:26:020
2301795994939,7cyclictest2397532-21unin-run10:25:012
2301794994938,8cyclictest2401545-21sh10:30:011
2301794994933,12cyclictest2427215-21sh11:01:001
2301793994941,5cyclictest2494192-21systemd-run12:25:010
2301793994926,20cyclictest2310765-21cron07:40:010
2301795994838,5cyclictest0-21swapper/210:36:042
2301794994836,8cyclictest0-21swapper/111:26:041
2301793994824,21cyclictest2367581-21unixbench_singl09:46:140
230179399481,14cyclictest2305698-21ntpq07:20:570
2301795994738,6cyclictest2309297-21systemd-run07:35:012
2301793994713,23cyclictest2483446-21ssh12:10:560
2301795994635,8cyclictest2393511-21ssh10:20:022
230179599463,35cyclictest2355027-21ssh09:30:572
2301794994537,5cyclictest1-21systemd09:25:021
2301794994537,5cyclictest1-21systemd09:25:021
230179599444,34cyclictest2471416-21ssh11:55:592
230179599444,34cyclictest2471416-21ssh11:55:592
2301795994438,3cyclictest0-21swapper/209:20:012
2301795994436,4cyclictest0-21swapper/210:30:562
2301795994431,8cyclictest2385447-21ssh10:10:012
2301795994431,8cyclictest2385447-21ssh10:10:012
2301795994427,7cyclictest0-21swapper/212:36:002
230179399442,16cyclictest2382955-21ntpq10:06:010
230179399442,16cyclictest2382955-21ntpq10:06:010
2301793994420,3cyclictest2402827-21ntp_kernel_err10:30:540
2301793994412,9cyclictest2390809-21diskmemload10:15:570
2301795994333,6cyclictest2379402-21unixbench-2d10:01:072
2301794994333,4cyclictest0-21swapper/111:31:041
230179499433,33cyclictest2459536-21ssh11:41:041
2301793994335,5cyclictest1511301-21cups-browsed10:42:140
2301793994335,5cyclictest1511301-21cups-browsed10:42:140
2301793994328,12cyclictest261-21systemd-journal09:40:000
2301793994318,5cyclictest2328801-21kworker/u8:0-xprtiod09:16:010
2301795994231,8cyclictest2334791-21sh09:00:012
2301795994231,6cyclictest1511301-21cups-browsed12:06:382
2301795994231,4cyclictest0-21swapper/212:01:202
2301795994221,9cyclictest1511301-21cups-browsed11:40:582
2301794994234,5cyclictest2337769-21diskmemload11:11:081
2301795994136,2cyclictest0-21swapper/208:00:012
2301795994134,4cyclictest2393509-21kworker/u8:9+rpciod10:55:012
2301795994134,4cyclictest2393509-21kworker/u8:9+rpciod10:55:012
2301794994133,5cyclictest2303348-21latency_hist07:15:021
230179399417,14cyclictest12450irq/33-eth011:11:010
2301793994114,2cyclictest0-21swapper/007:35:010
2301795994032,5cyclictest2337769-21diskmemload10:30:012
2301795994032,5cyclictest1056-21mta-sts-daemon11:10:142
2301794994033,3cyclictest0-21swapper/109:51:031
2301794994032,5cyclictest2483849-21wc12:11:081
2301794994032,5cyclictest2304781-21grep07:20:011
2301794994030,7cyclictest420-21avahi-daemon09:16:541
2301793994034,4cyclictest2346519-21aten_r2power_en09:20:440
2301793994034,4cyclictest2346519-21aten_r2power_en09:20:440
230179399402,14cyclictest2304146-21ntpq07:15:570
2301793994020,4cyclictest659-21snmpd11:59:400
2301793994020,4cyclictest659-21snmpd11:59:400
230179399401,13cyclictest2339091-21ssh09:10:550
2301795993929,4cyclictest0-21swapper/212:26:002
2301795993927,8cyclictest420-21avahi-daemon11:06:192
2301794993933,3cyclictest0-21swapper/110:45:021
2301794993933,3cyclictest0-21swapper/110:45:021
2301794993931,5cyclictest2377489-21basename10:00:011
2301794993930,4cyclictest0-21swapper/108:56:021
2301794993928,8cyclictest2438411-21sshd11:15:411
230179399394,13cyclictest12350irq/32-eth012:15:590
2301793993932,4cyclictest2318287-21cron08:05:000
2301793993919,3cyclictest2365658-21latency_hist09:45:020
2301793993919,2cyclictest0-21swapper/011:01:100
2301793993918,3cyclictest1051-21mta-sts-daemon11:27:050
2301793993917,2cyclictest0-21swapper/008:30:000
2301795993829,3cyclictest0-21swapper/212:11:052
2301795993829,2cyclictest0-21swapper/210:46:012
2301795993829,2cyclictest0-21swapper/210:46:012
230179599382,5cyclictest171rcu_preempt09:40:592
2301794993829,3cyclictest0-21swapper/112:16:031
2301793993819,16cyclictest261-21systemd-journal08:15:000
2301793993819,16cyclictest261-21systemd-journal08:15:000
2301793993816,3cyclictest0-21swapper/010:35:490
2301793993815,4cyclictest2439330-21ntpq11:16:020
2301793993813,5cyclictest1511301-21cups-browsed11:06:410
230179599372,27cyclictest2499555-21sh12:30:592
230179599372,26cyclictest2410915-21ssh10:40:552
230179599372,26cyclictest2410915-21ssh10:40:552
2301794993729,5cyclictest2369556-21sh09:50:011
2301794993727,7cyclictest2338902-21latency09:10:511
2301793993730,3cyclictest0-21swapper/011:20:470
230179399372,15cyclictest1622733-21munin-node11:34:290
2301793993714,6cyclictest12350irq/32-eth011:51:020
230179399371,19cyclictest2371088-21ssh09:51:050
230179399371,17cyclictest2386890-21rm10:11:000
230179599364,24cyclictest2455323-21ssh11:35:572
230179599363,24cyclictest2451260-21ssh11:30:552
2301795993630,3cyclictest0-21swapper/209:40:012
2301795993628,5cyclictest2449949-21cron11:30:002
2301795993628,5cyclictest2425740-21munin-run11:00:002
2301795993626,7cyclictest2427636-21timerwakeupswit11:01:082
2301795993626,6cyclictest2488144-21sed12:16:082
2301795993626,6cyclictest2371529-21unixbench_singl09:51:102
2301795993626,6cyclictest2350651-21telnet09:25:482
2301794993630,3cyclictest0-21swapper/112:00:471
2301794993629,3cyclictest0-21swapper/112:06:011
2301794993629,3cyclictest0-21swapper/111:56:021
2301794993629,3cyclictest0-21swapper/111:56:021
2301794993628,5cyclictest1-21systemd08:35:021
2301794993628,4cyclictest0-21swapper/112:25:551
2301794993626,7cyclictest420-21avahi-daemon10:32:101
2301793993628,5cyclictest2336273-21cron09:05:010
2301793993625,8cyclictest2355573-21timerwakeupswit09:31:080
2301795993529,3cyclictest0-21swapper/210:15:002
2301795993527,5cyclictest2331794-21systemd-run08:50:012
2301795993524,7cyclictest1511301-21cups-browsed11:51:362
2301794993528,3cyclictest0-21swapper/111:45:561
2301794993527,5cyclictest2361627-21munin-run09:40:011
2301794993527,5cyclictest2337689-21unixbench_singl09:06:071
2301794993514,7cyclictest62450lldpd10:11:381
230179399354,11cyclictest428-21mta-sts-daemon10:49:430
230179399354,11cyclictest428-21mta-sts-daemon10:49:430
2301793993527,5cyclictest1511301-21cups-browsed12:27:220
2301793993527,5cyclictest1511301-21cups-browsed10:01:190
230179399351,15cyclictest659-21snmpd12:09:490
230179599347,5cyclictest171rcu_preempt09:05:562
2301795993428,3cyclictest0-21swapper/207:20:012
2301795993426,4cyclictest1055-21mta-sts-daemon09:21:502
2301795993426,4cyclictest1055-21mta-sts-daemon09:21:502
2301795993425,6cyclictest420-21avahi-daemon08:31:032
2301795993422,9cyclictest2335675-21ntp_kernel_pll_09:00:582
2301794993426,4cyclictest0-21swapper/110:20:581
2301793993429,3cyclictest2337891-21latency_hist09:10:020
2301793993427,4cyclictest2422673-21idleruntime10:55:500
2301795993325,5cyclictest2318174-21unixbench_multi08:01:102
2301795993322,7cyclictest1511263-21cupsd11:22:272
230179599332,22cyclictest2439259-21ntpq11:15:592
2301794993326,3cyclictest0-21swapper/110:10:021
2301794993326,3cyclictest0-21swapper/110:10:021
2301794993325,5cyclictest2406315-21aten_r2power_po10:35:461
2301794993325,5cyclictest2315189-21unixbench_singl07:51:071
230179399334,9cyclictest2394938-21ntpq10:21:000
2301793993327,4cyclictest2331767-21cron08:50:010
2301793993321,7cyclictest2478109-21idleruntime-cro12:05:000
2301793993315,3cyclictest2333242-21kworker/u8:6-xprtiod08:55:520
2301795993224,5cyclictest2466121-21latency_hist11:50:022
230179599322,24cyclictest2374864-21ssh09:55:572
2301794993225,3cyclictest0-21swapper/112:36:021
2301794993225,3cyclictest0-21swapper/108:50:011
2301793993223,4cyclictest12450irq/33-eth010:51:020
2301793993223,4cyclictest12450irq/33-eth010:51:020
2301795993123,5cyclictest2325715-21head08:26:092
2301795993122,6cyclictest2310386-21mailstats07:36:062
2301795993120,8cyclictest2307134-21ntp_kernel_err07:25:562
230179499313,23cyclictest2423117-21ssh10:55:581
2301794993124,4cyclictest2350822-21gltestperf09:25:531
2301794993124,3cyclictest0-21swapper/107:31:031
2301794993122,6cyclictest516-21in:imuxsock09:35:001
2301793993126,3cyclictest2466059-21cron11:50:010
2301793993121,4cyclictest0-21swapper/007:41:010
2301793993112,13cyclictest12350irq/32-eth012:36:010
2301795993023,3cyclictest0-21swapper/209:46:012
2301795993019,5cyclictest0-21swapper/207:20:562
2301794993023,4cyclictest2442965-21uname11:20:511
2301794993022,5cyclictest2330196-21unixbench_singl08:41:081
2301794993022,5cyclictest1-21systemd09:05:011
230179399303,22cyclictest1622733-21munin-node08:05:570
230179399303,22cyclictest1622733-21munin-node08:05:570
2301793993023,3cyclictest0-21swapper/012:30:590
2301795992922,4cyclictest0-21swapper/207:45:012
2301795992920,6cyclictest1511301-21cups-browsed08:05:542
2301795992920,6cyclictest1511301-21cups-browsed08:05:542
2301794992922,4cyclictest0-21swapper/108:01:011
230179499292,20cyclictest2455443-21ssh11:36:011
2301794992921,3cyclictest0-21swapper/109:45:011
230179499291,23cyclictest0-21swapper/111:51:031
2301793992924,2cyclictest0-21swapper/007:50:020
2301793992923,3cyclictest2462206-21latency_hist11:45:020
2301793992922,4cyclictest548-21gdbus08:52:410
2301793992919,6cyclictest151ktimers/008:15:580
2301793992919,6cyclictest151ktimers/008:15:580
2301793992916,11cyclictest0-21swapper/007:50:540
230179599282,22cyclictest2337769-21diskmemload09:10:552
2301795992820,5cyclictest2315214-21unixbench_singl07:51:072
2301795992820,4cyclictest1051-21mta-sts-daemon07:11:012
2301794992821,4cyclictest2319801-21systemd08:10:011
2301794992821,4cyclictest2319801-21systemd08:10:011
2301794992820,4cyclictest0-21swapper/110:50:331
2301794992820,4cyclictest0-21swapper/110:50:331
2301794992818,7cyclictest2310665-21unixbench_multi07:36:091
2301795992723,2cyclictest0-21swapper/208:40:012
2301795992720,5cyclictest0-21swapper/207:10:012
2301794992720,4cyclictest2322766-21cron08:20:001
2301794992720,4cyclictest2322766-21cron08:20:001
2301794992720,3cyclictest0-21swapper/111:09:311
2301794992720,3cyclictest0-21swapper/108:51:011
230179399274,12cyclictest2337769-21diskmemload09:56:160
230179399272,19cyclictest12350irq/32-eth008:40:580
2301793992721,4cyclictest2303146-21tail07:11:070
2301793992718,7cyclictest2316765-21munin-plugin-st08:00:010
2301795992620,3cyclictest1054-21mta-sts-daemon08:11:042
2301795992620,3cyclictest1054-21mta-sts-daemon08:11:042
2301795992620,3cyclictest0-21swapper/207:50:012
2301795992617,5cyclictest0-21swapper/208:21:002
2301795992617,5cyclictest0-21swapper/208:21:002
2301795992616,8cyclictest2332536-21missed_timers08:50:542
2301795992612,10cyclictest428-21mta-sts-daemon08:40:572
2301794992620,3cyclictest0-21swapper/110:20:011
2301793992615,8cyclictest0-21swapper/007:30:030
2301794992519,3cyclictest0-21swapper/107:41:031
2301794992519,3cyclictest0-21swapper/107:30:011
2301794992519,3cyclictest0-21swapper/107:21:021
2301794992516,7cyclictest2312933-21kernelversion07:45:521
2301794992516,6cyclictest2316801-21systemd-run08:00:011
2301793992517,4cyclictest151ktimers/008:21:000
2301793992517,4cyclictest151ktimers/008:21:000
2301793992514,9cyclictest2327222-21unixbench_singl08:31:080
2301795992415,6cyclictest2322817-21munin-run08:20:012
2301795992415,6cyclictest2322817-21munin-run08:20:012
2301794992415,6cyclictest1511301-21cups-browsed08:36:001
2301794992315,5cyclictest1511301-21cups-browsed08:13:461
2301794992315,5cyclictest1511301-21cups-browsed08:13:461
230179499222,14cyclictest2323663-21ntpq08:20:591
230179499222,14cyclictest2323663-21ntpq08:20:591
2301794992216,3cyclictest0-21swapper/108:25:471
230179399222,6cyclictest1056-21mta-sts-daemon08:36:000
230179699202,10cyclictest0-21swapper/311:00:563
230179399200,17cyclictest2301814-21latency_hist07:10:020
230179699184,8cyclictest0-21swapper/310:16:033
230179699182,10cyclictest0-21swapper/311:15:573
230179699181,11cyclictest0-21swapper/312:35:523
230179499187,8cyclictest421-21dbus-daemon07:10:011
230179699173,8cyclictest0-21swapper/310:50:543
230179699173,8cyclictest0-21swapper/310:50:543
230179699173,8cyclictest0-21swapper/310:10:543
230179699172,9cyclictest0-21swapper/310:41:013
230179699172,9cyclictest0-21swapper/310:41:013
230179699172,8cyclictest0-21swapper/310:30:463
230179699163,8cyclictest0-21swapper/311:50:013
230179699162,8cyclictest0-21swapper/310:01:053
230179699161,9cyclictest0-21swapper/311:30:573
230179699161,9cyclictest0-21swapper/310:21:023
230179699154,5cyclictest0-21swapper/309:55:513
230179699152,8cyclictest0-21swapper/312:10:573
230179699152,8cyclictest0-21swapper/311:56:013
230179699152,8cyclictest0-21swapper/311:56:013
230179699152,8cyclictest0-21swapper/311:35:593
230179699152,8cyclictest0-21swapper/311:20:553
230179699152,8cyclictest0-21swapper/309:30:513
230179699152,7cyclictest0-21swapper/307:20:553
230179699151,8cyclictest0-21swapper/311:41:003
230179699151,8cyclictest0-21swapper/310:25:553
230179699151,8cyclictest0-21swapper/309:40:573
230179699151,7cyclictest0-21swapper/312:00:463
230179699151,7cyclictest0-21swapper/308:21:013
230179699151,7cyclictest0-21swapper/308:21:013
230179699143,6cyclictest0-21swapper/311:05:563
230179699143,6cyclictest0-21swapper/309:35:493
230179699143,6cyclictest0-21swapper/309:00:013
230179699142,8cyclictest0-21swapper/309:50:563
230179699142,7cyclictest0-21swapper/311:25:553
230179699142,7cyclictest0-21swapper/309:15:453
230179699142,6cyclictest0-21swapper/310:55:313
230179699141,9cyclictest0-21swapper/312:15:553
230179699141,8cyclictest0-21swapper/312:25:583
230179699141,8cyclictest0-21swapper/311:11:033
230179699141,8cyclictest0-21swapper/309:26:003
230179699141,7cyclictest0-21swapper/312:30:453
230179699141,6cyclictest0-21swapper/308:30:563
230179699141,6cyclictest0-21swapper/307:25:573
230179699133,4cyclictest0-21swapper/307:45:593
230179699132,7cyclictest0-21swapper/310:35:473
230179699132,7cyclictest0-21swapper/310:05:563
230179699132,7cyclictest0-21swapper/310:05:563
230179699132,7cyclictest0-21swapper/307:35:593
230179699132,5cyclictest0-21swapper/307:15:593
230179699131,8cyclictest0-21swapper/312:20:473
230179699131,8cyclictest0-21swapper/311:51:023
230179699131,7cyclictest0-21swapper/310:45:533
230179699131,7cyclictest0-21swapper/310:45:533
230179699131,7cyclictest0-21swapper/309:46:013
230179699131,7cyclictest0-21swapper/309:10:513
230179699131,6cyclictest0-21swapper/308:06:003
230179699131,6cyclictest0-21swapper/308:06:003
230179699131,5cyclictest0-21swapper/308:00:543
230179699124,6cyclictest0-21swapper/312:06:023
230179699123,4cyclictest0-21swapper/308:15:573
230179699123,4cyclictest0-21swapper/308:15:573
230179699122,6cyclictest0-21swapper/308:36:003
230179699122,5cyclictest0-21swapper/307:40:563
230179699121,6cyclictest0-21swapper/308:30:013
230179699121,6cyclictest0-21swapper/307:55:573
230179699121,6cyclictest0-21swapper/307:35:013
230179699114,5cyclictest0-21swapper/309:21:023
230179699114,5cyclictest0-21swapper/309:21:023
230179699111,6cyclictest0-21swapper/309:05:523
230179699111,6cyclictest0-21swapper/308:51:083
230179699111,6cyclictest0-21swapper/308:10:503
230179699111,6cyclictest0-21swapper/308:10:503
230179699111,6cyclictest0-21swapper/307:50:473
230179699102,5cyclictest0-21swapper/308:45:563
230179699101,6cyclictest0-21swapper/309:00:563
230179699101,5cyclictest0-21swapper/307:10:463
23017969990,5cyclictest0-21swapper/308:40:503
23017969971,4cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional