You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 23:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Fri Sep 11, 2026 12:42:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2340086995623,6cyclictest12750irq/33-eth009:26:110
2340086995623,6cyclictest12750irq/33-eth009:26:110
2340087995042,5cyclictest1-21systemd12:40:021
234008899491,11cyclictest2483908-21ssh12:06:132
2340088994636,7cyclictest421-21dbus-daemon12:26:142
2340087994638,5cyclictest2400524-21systemd-run09:50:011
234008899444,36cyclictest2471704-21ssh11:46:102
234008799445,33cyclictest2480820-21rm12:01:111
2340087994436,5cyclictest2449246-21latency_hist11:10:021
2340086994437,4cyclictest2456990-21grep11:21:220
2340086994437,4cyclictest2456990-21grep11:21:220
2340086994437,4cyclictest2358097-21systemd-run08:10:010
2340086994430,12cyclictest1558327-21cups-browsed10:46:020
2340086994424,15cyclictest151ktimers/008:46:150
2340087994334,6cyclictest2403536-21cron09:55:011
2340088994234,5cyclictest2500822-21idleruntime-cro12:35:012
2340088994232,5cyclictest0-21swapper/211:36:102
2340087994236,3cyclictest0-21swapper/110:45:021
2340087994234,5cyclictest2438045-21missed_timers10:51:071
2340087994233,6cyclictest2430903-21systemd-journal10:40:011
2340088994133,5cyclictest2426571-21unixbench-2d10:31:252
2340088994133,5cyclictest2391336-21cron09:35:002
2340088994133,5cyclictest2391336-21cron09:35:002
2340088994131,7cyclictest1000-21mta-sts-daemon10:55:172
234008899411,36cyclictest2420052-21ssh10:21:122
234008899404,26cyclictest2474709-21ssh11:51:102
2340088994034,3cyclictest0-21swapper/211:20:012
2340088994032,5cyclictest2397462-21munin-plugin-st09:45:002
2340088994031,6cyclictest2493174-21sendmail_mailst12:21:182
2340086994034,4cyclictest2371584-21systemd-run08:55:010
2340086994031,7cyclictest265-21systemd-journal09:05:010
2340088993930,6cyclictest2352596-21grep07:51:022
2340088993918,16cyclictest351ktimers/210:51:132
2340087993933,3cyclictest0-21swapper/112:15:011
2340087993933,3cyclictest0-21swapper/112:15:011
2340087993933,3cyclictest0-21swapper/109:21:161
2340087993931,5cyclictest2418754-21idleruntime-cro10:20:011
2340086993932,4cyclictest2433910-21cron10:45:010
2340086993929,8cyclictest2464356-21ssh11:35:010
234008699392,32cyclictest2416916-21ssh10:16:090
234008899383,27cyclictest2435218-21sshd10:46:122
2340088993831,4cyclictest2481036-21mailstats12:01:172
2340088993831,4cyclictest0-21swapper/209:56:092
2340088993830,5cyclictest2388303-21ssh09:30:012
2340088993830,5cyclictest2388303-21ssh09:30:012
2340088993830,4cyclictest0-21swapper/212:16:262
2340088993829,5cyclictest0-21swapper/209:46:142
234008799383,27cyclictest2413889-21ssh10:11:131
2340087993829,6cyclictest2376063-21sh09:10:011
2340086993832,4cyclictest2380547-21proc_pri09:16:200
2340086993829,3cyclictest0-21swapper/012:11:130
2340086993829,3cyclictest0-21swapper/012:11:130
2340086993822,11cyclictest12650irq/32-eth011:41:160
2340088993729,5cyclictest2456995-21unixbench-2d11:21:222
2340088993729,5cyclictest2456995-21unixbench-2d11:21:222
2340088993729,4cyclictest0-21swapper/210:41:162
2340088993729,4cyclictest0-21swapper/209:21:072
2340088993728,6cyclictest420-21avahi-daemon11:55:452
2340088993726,4cyclictest0-21swapper/208:55:012
2340087993729,5cyclictest421-21dbus-daemon11:25:021
2340087993729,5cyclictest421-21dbus-daemon11:25:021
2340087993729,5cyclictest2462167-21fschecks_count11:31:101
2340087993729,5cyclictest2365590-21systemd-run08:35:011
2340087993726,8cyclictest0-21swapper/109:26:121
2340087993726,8cyclictest0-21swapper/109:26:121
2340086993715,12cyclictest151ktimers/007:21:110
2340088993628,5cyclictest2364088-21systemd-run08:30:012
2340088993626,6cyclictest2414144-21sendmail_mailst10:11:212
2340088993620,10cyclictest1558327-21cups-browsed11:44:232
234008799363,30cyclictest2419963-21ssh10:21:091
234008799363,22cyclictest1001-21mta-sts-daemon09:56:111
2340087993630,3cyclictest2443782-21kworker/u8:11-nfsiod11:20:021
2340087993629,4cyclictest2349093-21sendmail07:40:011
2340087993629,3cyclictest0-21swapper/112:06:141
2340087993628,5cyclictest1-21systemd08:05:011
2340087993627,6cyclictest2390147-21unixbench_singl09:31:251
2340087993627,6cyclictest2390147-21unixbench_singl09:31:251
2340086993630,4cyclictest1003-21mta-sts-daemon12:26:140
2340086993616,12cyclictest1002-21mta-sts-daemon10:36:190
2340088993528,3cyclictest0-21swapper/211:26:082
2340088993528,3cyclictest0-21swapper/211:26:082
2340088993528,3cyclictest0-21swapper/210:20:012
2340088993527,5cyclictest2346096-21systemd-run07:30:022
2340088993526,6cyclictest2402144-21threads09:51:252
2340088993524,8cyclictest1002-21mta-sts-daemon10:10:022
234008899352,27cyclictest2392615-21ssh09:36:112
2340087993527,5cyclictest2412797-21latency_hist10:10:021
234008699353,26cyclictest2377365-21sshd09:11:120
2340086993527,6cyclictest2494773-21systemd12:25:020
2340086993526,6cyclictest2350572-21cron07:45:010
2340088993427,4cyclictest0-21swapper/210:00:592
2340088993426,5cyclictest2365509-21unixbench_singl08:31:212
2340088993425,6cyclictest2449712-21aten_r2power_en11:10:582
2340088993425,4cyclictest0-21swapper/208:21:122
2340088993425,4cyclictest0-21swapper/208:21:122
234008899342,22cyclictest2380449-21ssh09:16:172
2340087993428,2cyclictest0-21swapper/108:36:121
2340087993427,4cyclictest1002-21mta-sts-daemon11:28:391
2340087993427,4cyclictest1002-21mta-sts-daemon11:28:391
2340087993427,3cyclictest0-21swapper/109:36:001
2340087993424,7cyclictest2380263-21missed_timers09:16:101
234008799341,24cyclictest2444506-21ssh11:01:181
2340086993428,4cyclictest2397457-21latency_hist09:45:000
2340086993427,4cyclictest2482595-21sh12:05:010
2340086993426,4cyclictest151ktimers/012:06:100
2340086993426,3cyclictest0-21swapper/007:16:100
2340086993425,7cyclictest2405209-21timerandwakeup09:56:210
2340088993325,5cyclictest2447948-21unixbench_singl11:06:212
2340088993325,5cyclictest0-21swapper/212:11:192
2340088993325,5cyclictest0-21swapper/212:11:192
2340088993324,6cyclictest439-21systemd-logind08:50:012
2340088993324,6cyclictest2356577-21cron08:05:012
2340088993323,6cyclictest2340595-21fschecks_count07:11:032
2340088993321,9cyclictest2429131-21ntp_offset10:36:152
234008799333,12cyclictest2441271-21rm10:56:121
2340087993327,3cyclictest0-21swapper/111:36:021
2340087993327,3cyclictest0-21swapper/107:51:121
2340087993326,4cyclictest2471398-21kernelversion11:46:041
2340087993326,4cyclictest1002-21mta-sts-daemon10:26:091
2340087993326,4cyclictest1000-21mta-sts-daemon07:41:091
2340087993325,5cyclictest1558327-21cups-browsed11:12:061
2340086993328,3cyclictest1003-21mta-sts-daemon10:06:190
2340086993326,4cyclictest2355048-21kworker/u8:9-xprtiod08:36:150
2340086993325,5cyclictest1558327-21cups-browsed09:39:550
2340086993324,7cyclictest2453317-21needreboot11:16:070
2340086993320,10cyclictest12650irq/32-eth010:51:120
2340086993319,8cyclictest12650irq/32-eth008:56:130
234008699331,24cyclictest2389587-21ssh09:31:150
234008699331,24cyclictest2389587-21ssh09:31:150
2340088993225,4cyclictest0-21swapper/211:01:122
2340088993224,5cyclictest2359164-21mailstats08:11:162
2340088993223,6cyclictest2344584-21sh07:25:002
2340087993226,3cyclictest0-21swapper/110:01:131
2340087993226,3cyclictest0-21swapper/108:16:041
2340087993225,3cyclictest0-21swapper/112:15:591
2340087993224,5cyclictest2469193-21unixbench_multi11:41:231
2340086993227,3cyclictest2340085-21cyclictest11:51:100
2340086993226,2cyclictest0-21swapper/008:20:010
2340086993225,4cyclictest2478253-21sed11:56:210
2340086993225,4cyclictest2449978-21fschecks_time11:11:020
2340086993225,4cyclictest2385272-21ssh09:25:010
234008699322,24cyclictest2398679-21ssh09:46:100
2340088993124,4cyclictest1003-21mta-sts-daemon11:31:102
2340088993123,5cyclictest420-21avahi-daemon07:55:532
2340088993123,5cyclictest2348984-21unixbench_singl07:36:232
234008899312,18cyclictest2342465-21sshd07:16:122
2340088993120,6cyclictest0-21swapper/209:11:122
234008899311,24cyclictest2366499-21sshd08:36:122
2340087993126,3cyclictest0-21swapper/109:00:011
2340087993122,7cyclictest2436965-21idleruntime-cro10:50:011
2340087993117,10cyclictest421-21dbus-daemon09:01:111
2340087993113,6cyclictest2376066-21diskmemload09:41:081
2340086993125,3cyclictest0-21swapper/011:40:020
2340086993122,6cyclictest2365558-21cron08:35:000
2340086993120,8cyclictest421-21dbus-daemon09:51:290
2340086993118,10cyclictest0-21swapper/010:01:010
2340086993117,10cyclictest421-21dbus-daemon11:45:060
2340088993022,3cyclictest0-21swapper/210:26:102
2340088993021,6cyclictest1558327-21cups-browsed12:35:132
2340087993023,3cyclictest0-21swapper/111:51:131
2340087993022,5cyclictest2359571-21munin-plugin-st08:15:011
2340087993022,5cyclictest1558327-21cups-browsed12:33:331
2340086993024,4cyclictest1002-21mta-sts-daemon11:28:330
2340086993024,4cyclictest1002-21mta-sts-daemon11:28:330
2340086993022,6cyclictest2499648-21unixbench_singl12:31:280
2340086993020,7cyclictest0-21swapper/010:30:010
2340088992923,3cyclictest0-21swapper/208:20:002
2340088992923,3cyclictest0-21swapper/207:31:132
2340088992912,4cyclictest171rcu_preempt08:56:082
234008799293,21cyclictest2377350-21ssh09:11:121
2340087992923,3cyclictest0-21swapper/108:51:121
2340087992922,5cyclictest2362325-21timerandwakeup08:21:201
2340087992922,5cyclictest2362325-21timerandwakeup08:21:201
2340087992921,5cyclictest2343619-21fschecks_time07:21:031
2340087992920,5cyclictest566-21gmain07:35:011
2340087992920,5cyclictest0-21swapper/112:25:011
234008799291,22cyclictest2496012-21ssh12:26:101
2340086992924,3cyclictest0-21swapper/007:46:120
2340086992923,4cyclictest2489526-21fschecks_time12:16:060
2340086992923,3cyclictest2363971-21unixbench_multi08:26:210
2340086992922,5cyclictest1-21systemd08:00:010
2340086992921,4cyclictest0-21swapper/007:31:130
2340086992911,14cyclictest2420019-21ntp_kernel_pll_10:21:110
234008899282,4cyclictest171rcu_preempt09:06:092
2340088992819,6cyclictest2367600-21fschecks_count08:41:042
234008799284,16cyclictest2345517-21sshd07:26:121
234008799282,17cyclictest265-21systemd-journal10:31:121
234008699289,11cyclictest1558324-21cupsd07:11:130
234008699283,16cyclictest151ktimers/010:11:130
2340086992821,4cyclictest2361619-21fschecks_time08:21:030
2340086992821,4cyclictest2361619-21fschecks_time08:21:030
2340086992820,6cyclictest2443373-21sh11:00:190
2340086992819,6cyclictest2353557-21cron07:55:010
2340086992815,4cyclictest2440638-21aten_r2power_fr10:56:000
2340086992811,9cyclictest12650irq/32-eth012:36:120
234008899273,19cyclictest2357499-21sshd08:06:112
2340087992721,2cyclictest0-21swapper/111:56:051
2340087992712,11cyclictest1558327-21cups-browsed08:26:091
2340086992723,2cyclictest0-21swapper/010:31:090
2340086992720,4cyclictest2348956-21unixbench_multi07:36:220
2340086992711,10cyclictest12650irq/32-eth011:06:130
234008899262,17cyclictest1558327-21cups-browsed09:01:122
2340088992619,4cyclictest2351393-21needreboot07:46:062
234008899261,6cyclictest171rcu_preempt07:41:092
2340087992620,3cyclictest0-21swapper/107:15:001
2340087992620,3cyclictest0-21swapper/107:10:011
2340087992620,3cyclictest0-21swapper/107:10:011
2340087992620,2cyclictest0-21swapper/108:41:181
2340086992621,3cyclictest2356474-21unixbench_multi08:01:200
2340086992621,2cyclictest0-21swapper/009:10:010
2340086992616,7cyclictest265-21systemd-journal08:45:020
2340087992518,4cyclictest421-21dbus-daemon07:57:531
2340087992518,4cyclictest2351993-21unixbench_singl07:46:201
234008799251,7cyclictest171rcu_preempt08:46:141
2340086992517,6cyclictest2345832-21timerandwakeup07:26:200
2340087992417,4cyclictest2342903-21unixbench-2d07:16:241
2340087992318,2cyclictest0-21swapper/108:10:021
2340086992317,4cyclictest2359559-21cron08:15:010
2340086992115,4cyclictest2340085-21cyclictest07:10:010
2340086992115,4cyclictest2340085-21cyclictest07:10:010
234008899207,9cyclictest421-21dbus-daemon07:10:012
234008899207,9cyclictest421-21dbus-daemon07:10:012
234008999173,7cyclictest0-21swapper/311:36:173
234008999163,7cyclictest0-21swapper/310:56:153
234008999162,8cyclictest0-21swapper/310:26:133
234008999162,7cyclictest0-21swapper/311:21:123
234008999162,7cyclictest0-21swapper/311:21:123
234008999161,8cyclictest0-21swapper/310:06:163
234008999152,8cyclictest0-21swapper/308:50:023
234008999152,7cyclictest0-21swapper/310:31:123
234008999151,7cyclictest0-21swapper/310:36:153
234008999151,6cyclictest0-21swapper/308:26:103
234008999151,6cyclictest0-21swapper/307:16:153
234008999144,6cyclictest0-21swapper/309:31:123
234008999144,6cyclictest0-21swapper/309:31:123
234008999142,6cyclictest0-21swapper/312:26:083
234008999142,5cyclictest0-21swapper/311:01:103
234008999142,5cyclictest0-21swapper/309:46:093
234008999141,6cyclictest0-21swapper/311:11:073
234008999141,6cyclictest0-21swapper/309:26:113
234008999141,6cyclictest0-21swapper/309:26:113
234008999141,6cyclictest0-21swapper/309:01:093
234008999141,6cyclictest0-21swapper/308:21:103
234008999141,6cyclictest0-21swapper/308:21:103
234008999141,6cyclictest0-21swapper/307:26:103
234008999133,7cyclictest0-21swapper/309:51:093
234008999133,5cyclictest0-21swapper/309:41:143
234008999132,6cyclictest0-21swapper/310:21:083
234008999132,6cyclictest0-21swapper/309:16:263
234008999132,5cyclictest0-21swapper/310:01:103
234008999132,5cyclictest0-21swapper/307:51:093
234008999131,7cyclictest0-21swapper/311:06:153
234008999131,6cyclictest0-21swapper/310:51:103
234008999131,6cyclictest0-21swapper/310:16:093
234008999131,6cyclictest0-21swapper/308:56:093
234008999131,6cyclictest0-21swapper/308:06:153
234008999131,6cyclictest0-21swapper/307:46:103
234008999131,6cyclictest0-21swapper/307:21:113
234008999131,5cyclictest0-21swapper/308:31:083
234008999131,5cyclictest0-21swapper/307:36:113
234008999123,7cyclictest0-21swapper/310:46:093
234008999122,6cyclictest0-21swapper/311:46:093
234008999122,6cyclictest0-21swapper/311:16:123
234008999122,6cyclictest0-21swapper/309:21:123
234008999122,6cyclictest0-21swapper/309:11:143
234008999122,5cyclictest0-21swapper/311:26:133
234008999122,5cyclictest0-21swapper/311:26:133
234008999122,5cyclictest0-21swapper/308:36:103
234008999121,6cyclictest0-21swapper/312:16:183
234008999121,6cyclictest0-21swapper/312:01:113
234008999121,6cyclictest0-21swapper/311:51:033
234008999121,6cyclictest0-21swapper/310:41:113
234008999121,6cyclictest0-21swapper/308:16:093
234008999121,6cyclictest0-21swapper/307:35:013
234008999121,5cyclictest0-21swapper/309:55:593
234008999121,5cyclictest0-21swapper/308:01:073
234008999121,3cyclictest0-21swapper/310:11:133
234008999120,5cyclictest0-21swapper/308:51:073
234008999120,5cyclictest0-21swapper/307:11:113
234008999113,6cyclictest0-21swapper/312:06:083
234008999112,6cyclictest0-21swapper/308:45:023
234008999111,6cyclictest0-21swapper/311:56:073
234008999111,6cyclictest0-21swapper/311:31:223
234008999111,6cyclictest0-21swapper/309:36:203
234008999101,6cyclictest0-21swapper/312:36:093
234008999101,6cyclictest0-21swapper/311:41:003
234008999101,5cyclictest0-21swapper/312:30:123
23400899992,5cyclictest0-21swapper/309:06:033
23400899991,6cyclictest0-21swapper/312:11:163
23400899991,6cyclictest0-21swapper/312:11:163
23400899991,5cyclictest0-21swapper/312:25:023
23400899991,5cyclictest0-21swapper/308:11:033
23400899991,5cyclictest0-21swapper/307:56:113
23400899991,5cyclictest0-21swapper/307:41:073
23400899971,3cyclictest0-21swapper/307:10:013
23400899971,3cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional