You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-10 - 19:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Thu Sep 10, 2026 12:42:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
483677995445,6cyclictest510707-21munin-plugin-st08:40:011
483678994738,6cyclictest265-21systemd-journal10:41:112
483677994738,6cyclictest519733-21systemd-run09:10:011
483677994738,6cyclictest519733-21systemd-run09:10:011
483676994738,5cyclictest151ktimers/011:26:090
48367899461,36cyclictest612392-21rm11:41:112
48367899461,36cyclictest612392-21rm11:41:112
483677994638,5cyclictest611090-21sendmail11:40:011
483677994537,5cyclictest644480-21munin-plugin-st12:35:011
483677994536,6cyclictest439-21systemd-logind11:55:011
483677994536,6cyclictest439-21systemd-logind11:55:011
483677994535,6cyclictest3897124-21cups-browsed10:06:101
483676994531,9cyclictest12650irq/32-eth011:51:120
483676994531,9cyclictest12650irq/32-eth011:51:120
483678994436,5cyclictest596692-21cut11:16:032
483678994435,5cyclictest528915-21ssh09:25:012
483678994333,6cyclictest3897124-21cups-browsed12:29:352
48367799433,29cyclictest606345-21ssh11:31:181
483678994233,5cyclictest638421-21munin-plugin-st12:25:012
483678994233,5cyclictest486666-21idleruntime-cro07:20:012
483677994234,5cyclictest527577-21timerwakeupswit09:21:261
483677994233,6cyclictest3897124-21cups-browsed12:37:521
483677994233,5cyclictest565453-21ssh10:25:011
483676994233,7cyclictest638421-21munin-plugin-st12:25:010
483676994225,11cyclictest12650irq/32-eth009:06:070
483676994225,11cyclictest12650irq/32-eth009:06:070
483677994134,4cyclictest1001-21mta-sts-daemon10:01:021
483677994133,3cyclictest0-21swapper/112:06:151
483677994133,3cyclictest0-21swapper/112:06:151
483677994132,5cyclictest489692-21systemd-run07:30:011
483676994132,6cyclictest559372-21sh10:15:010
483676994131,7cyclictest560079-21cpu10:16:010
483676994130,8cyclictest0-21swapper/009:40:010
483676994127,11cyclictest530110-21ssh09:26:090
483678994028,8cyclictest421-21dbus-daemon11:56:532
483677994033,4cyclictest1001-21mta-sts-daemon10:48:101
483677994032,5cyclictest515224-21systemd-run08:55:011
483677994032,5cyclictest515224-21systemd-run08:55:011
483677994031,5cyclictest486707-21systemd-run07:20:011
483677994031,5cyclictest0-21swapper/110:35:011
483678993933,3cyclictest0-21swapper/209:15:002
483678993930,5cyclictest578473-21gltestperf10:46:032
483678993927,8cyclictest421-21dbus-daemon07:46:082
483677993932,5cyclictest0-21swapper/109:56:111
483677993930,6cyclictest1002-21mta-sts-daemon09:50:461
483676993933,3cyclictest0-21swapper/011:40:010
483676993925,10cyclictest522770-21latency_hist09:15:020
48367699392,31cyclictest665-21snmpd10:30:140
48367699392,26cyclictest588021-21ssh11:01:110
483676993917,12cyclictest12650irq/32-eth009:56:090
483678993830,5cyclictest584513-21fschecks_count10:56:012
483678993829,5cyclictest509237-21systemd-run08:35:012
483678993826,6cyclictest583698-21kworker/u8:11-events_unbound11:01:152
483678993822,8cyclictest351ktimers/209:26:112
483677993832,3cyclictest0-21swapper/109:00:001
483677993832,3cyclictest0-21swapper/109:00:001
483677993831,4cyclictest525853-21idleruntime-cro09:20:011
483677993830,5cyclictest532103-21latency_hist09:30:031
483677993829,5cyclictest631030-21sed12:11:211
483677993829,5cyclictest631030-21sed12:11:211
483677993822,5cyclictest518240-21kworker/u8:15+xprtiod10:40:011
483676993831,4cyclictest515230-21systemd-run08:55:010
483676993831,4cyclictest515230-21systemd-run08:55:010
483676993827,8cyclictest0-21swapper/011:31:110
483676993825,8cyclictest12650irq/32-eth010:21:130
483678993731,4cyclictest483675-21cyclictest12:01:122
483678993729,5cyclictest513735-21systemd-run08:50:012
483678993728,5cyclictest643209-21unixbench-2d12:31:252
483677993730,4cyclictest585450-21unixbench_multi10:56:211
483677993730,4cyclictest522764-21ssh09:15:001
483676993730,4cyclictest0-21swapper/010:40:010
483676993728,4cyclictest0-21swapper/007:46:080
483676993727,7cyclictest645535-21latency12:36:100
483676993727,5cyclictest0-21swapper/010:26:090
483676993724,9cyclictest12650irq/32-eth012:11:120
483676993724,9cyclictest12650irq/32-eth012:11:120
483676993724,10cyclictest547157-21sh09:55:000
483676993723,11cyclictest635369-21sendmail12:20:000
483678993628,5cyclictest569301-21fschecks_count10:31:022
483678993626,7cyclictest491163-21/usr/sbin/munin07:35:012
483678993625,3cyclictest0-21swapper/212:14:022
483678993625,3cyclictest0-21swapper/212:14:022
483676993630,3cyclictest485043-21tail07:11:210
483676993628,5cyclictest582510-21unixbench_singl10:51:220
483676993626,7cyclictest527356-21mailstats09:21:230
483676993621,13cyclictest512226-21cut08:45:020
483678993524,8cyclictest572668-21needreboot10:36:092
483677993530,2cyclictest0-21swapper/110:15:011
483677993527,5cyclictest513601-21unixbench_multi08:46:191
483677993526,5cyclictest421-21dbus-daemon11:05:011
483677993525,6cyclictest3897124-21cups-browsed09:01:001
483677993525,6cyclictest3897124-21cups-browsed09:01:001
483676993529,4cyclictest586747-21grep11:00:010
483676993527,4cyclictest0-21swapper/007:36:110
483676993527,4cyclictest0-21swapper/007:36:110
483676993526,6cyclictest590403-21aten_r2power_fr11:05:580
483678993424,7cyclictest0-21swapper/208:05:012
483678993419,10cyclictest493603-21sshd07:41:122
48367799344,24cyclictest581884-21ssh10:51:101
483677993426,5cyclictest615880-21unixbench-2d11:46:241
483677993426,5cyclictest615880-21unixbench-2d11:46:241
483677993425,6cyclictest1000-21mta-sts-daemon12:29:291
483676993427,4cyclictest644498-21systemd-run12:35:010
483676993427,3cyclictest0-21swapper/012:00:010
483676993427,3cyclictest0-21swapper/010:46:220
483676993426,5cyclictest601940-21cron11:25:010
483676993425,6cyclictest420-21avahi-daemon11:46:240
483676993425,6cyclictest420-21avahi-daemon11:46:240
483676993425,6cyclictest3897124-21cups-browsed09:16:260
483676993424,7cyclictest503202-21cron08:15:010
48367699342,24cyclictest639828-21ssh12:26:180
48367699341,28cyclictest623-21sshd07:26:110
48367899335,13cyclictest560580-21ssh10:16:132
483678993325,5cyclictest558062-21unixbench-2d10:11:202
483678993324,6cyclictest489663-21cron07:30:012
483678993324,5cyclictest503236-21systemd-run08:15:012
483678993324,5cyclictest0-21swapper/209:41:122
483678993324,4cyclictest0-21swapper/209:36:142
483678993323,7cyclictest548916-21timerwakeupswit09:56:222
483678993322,8cyclictest633984-21timerandwakeup12:16:192
48367799333,23cyclictest612423-21ssh11:41:141
48367799333,23cyclictest612423-21ssh11:41:141
48367799333,21cyclictest665-21snmpd08:21:101
483677993328,3cyclictest0-21swapper/109:45:011
483677993326,4cyclictest568457-21cron10:30:011
483677993326,4cyclictest488329-21latency_hist07:25:021
483677993325,5cyclictest636383-21cut12:21:071
483677993325,5cyclictest598889-21munin-run11:20:011
483677993322,8cyclictest593351-21/usr/sbin/munin11:11:221
483676993328,2cyclictest0-21swapper/008:20:010
483676993324,6cyclictest553795-21/usr/sbin/munin10:06:070
483676993318,9cyclictest12650irq/32-eth009:46:170
483678993226,4cyclictest1000-21mta-sts-daemon11:39:222
483678993225,4cyclictest0-21swapper/208:40:012
483678993225,3cyclictest0-21swapper/211:21:212
483678993224,5cyclictest504726-21idleruntime-cro08:20:012
483678993223,4cyclictest0-21swapper/210:26:142
483678993222,8cyclictest541567-21sh09:45:502
483678993222,7cyclictest545060-21if_wlan009:51:042
483677993225,3cyclictest0-21swapper/110:45:011
483677993224,5cyclictest600206-21ntp_offset11:21:121
483677993224,5cyclictest484182-21fschecks_count07:11:021
48367699324,21cyclictest575876-21ssh10:41:120
48367699323,24cyclictest493605-21modprobe07:41:120
483676993227,2cyclictest0-21swapper/009:41:120
483676993226,3cyclictest0-21swapper/008:25:010
48367899315,18cyclictest1002-21mta-sts-daemon07:51:112
48367899313,22cyclictest645714-21ssh12:36:152
48367899313,17cyclictest554718-21awk10:06:162
483678993124,4cyclictest1000-21mta-sts-daemon11:28:242
483678993123,4cyclictest0-21swapper/208:41:102
483678993122,6cyclictest0-21swapper/207:15:012
48367899312,25cyclictest606191-21ssh11:31:122
483677993125,4cyclictest483675-21cyclictest09:35:011
483676993121,7cyclictest0-21swapper/008:10:010
483676993119,8cyclictest12650irq/32-eth011:16:170
483676993113,14cyclictest12650irq/32-eth012:06:160
483676993113,14cyclictest12650irq/32-eth012:06:160
483678993022,4cyclictest593410-21aten_r2power_en11:11:012
483678993021,7cyclictest581609-21sh10:51:052
483678993021,6cyclictest516140-21ntpq08:56:122
483678993021,6cyclictest516140-21ntpq08:56:122
483678993020,6cyclictest564254-21unixbench_singl10:21:222
483677993024,3cyclictest0-21swapper/110:16:171
483677993023,4cyclictest494175-21munin-plugin-st07:45:001
483677993023,3cyclictest0-21swapper/111:26:131
483677993022,5cyclictest497162-21grep07:55:011
483677993022,5cyclictest420-21avahi-daemon08:45:021
483676993022,6cyclictest613858-21sshd11:44:110
483676993022,6cyclictest613858-21sshd11:44:110
483676993020,7cyclictest507103-21ntp_kernel_pll_08:26:100
483676993020,7cyclictest12650irq/32-eth008:36:120
483678992923,3cyclictest602229-21kworker/u8:1-nfsiod11:55:012
483678992923,3cyclictest602229-21kworker/u8:1-nfsiod11:55:012
48367899292,15cyclictest533237-21ntpq09:31:112
483678992921,5cyclictest515085-21tail08:51:252
483678992921,5cyclictest515085-21tail08:51:252
483678992920,6cyclictest507720-21idleruntime-cro08:30:012
483678992920,6cyclictest488100-21unixbench_singl07:21:212
483678992917,8cyclictest341rcuc/209:01:122
483678992917,8cyclictest341rcuc/209:01:122
48367799293,19cyclictest633528-21ssh12:16:071
483677992924,2cyclictest0-21swapper/107:31:231
483677992922,4cyclictest1003-21mta-sts-daemon12:04:301
483677992921,5cyclictest1002-21mta-sts-daemon09:48:031
48367699292,7cyclictest551510-21ntpq10:01:120
483676992923,3cyclictest0-21swapper/007:31:120
483676992923,3cyclictest0-21swapper/007:21:130
483678992822,2cyclictest0-21swapper/212:06:052
483678992822,2cyclictest0-21swapper/212:06:052
483678992821,4cyclictest615873-21sh11:46:242
483678992821,4cyclictest615873-21sh11:46:242
483677992821,4cyclictest492612-21unixbench_singl07:36:201
483677992821,4cyclictest492612-21unixbench_singl07:36:201
483677992820,4cyclictest3897124-21cups-browsed09:35:111
483677992815,9cyclictest621140-21/usr/sbin/munin11:56:051
483676992821,4cyclictest3897124-21cups-browsed09:31:200
483676992820,6cyclictest0-21swapper/012:01:000
48367699281,22cyclictest594063-21ssh11:11:120
48367899272,19cyclictest551466-21ssh10:01:102
483678992720,4cyclictest525843-21sendmail09:20:012
483678992719,5cyclictest590959-21ntp_kernel_err11:06:062
483677992720,5cyclictest0-21swapper/108:00:011
483677992719,5cyclictest590365-21ssh11:05:581
483677992719,5cyclictest1000-21mta-sts-daemon08:25:571
483678992620,4cyclictest501456-21timerwakeupswit08:06:202
483678992619,4cyclictest518523-21aten_r2power_en09:05:592
483678992619,4cyclictest518523-21aten_r2power_en09:05:592
48367799264,5cyclictest171rcu_preempt08:01:131
48367799261,18cyclictest1-21systemd08:20:011
48367799260,4cyclictest171rcu_preempt07:46:091
48367699265,15cyclictest665-21snmpd08:01:110
483676992617,4cyclictest0-21swapper/009:00:000
483676992617,4cyclictest0-21swapper/009:00:000
483678992520,2cyclictest0-21swapper/208:00:012
483678992515,7cyclictest491833-21latency07:36:042
483678992515,7cyclictest491833-21latency07:36:042
483677992519,3cyclictest0-21swapper/108:11:121
483677992519,3cyclictest0-21swapper/108:06:041
483677992518,4cyclictest57-21kcompactd008:35:011
483676992519,4cyclictest498655-21munin-plugin-st08:00:010
483676992510,10cyclictest513188-21modprobe08:46:120
483676992415,5cyclictest12750irq/33-eth009:01:090
483676992415,5cyclictest12750irq/33-eth009:01:090
483676992414,7cyclictest486655-21cron07:20:010
48367699232,16cyclictest508680-21ntpq08:31:150
483676992318,3cyclictest496886-21timerandwakeup07:51:190
483678992214,6cyclictest3897119-21cupsd08:21:002
483677992217,2cyclictest0-21swapper/107:10:021
48367999183,7cyclictest0-21swapper/312:31:123
48367999183,6cyclictest0-21swapper/309:56:113
483678991812,3cyclictest0-21swapper/207:10:012
48367999173,8cyclictest0-21swapper/311:26:123
48367999172,6cyclictest0-21swapper/308:31:143
48367999171,7cyclictest0-21swapper/310:16:143
48367699177,7cyclictest1-21systemd07:10:010
48367999163,6cyclictest0-21swapper/310:56:113
48367999163,6cyclictest0-21swapper/309:26:113
48367999162,7cyclictest0-21swapper/309:36:113
48367999161,6cyclictest0-21swapper/308:51:123
48367999161,6cyclictest0-21swapper/308:51:123
48367999154,7cyclictest0-21swapper/310:46:123
48367999153,6cyclictest0-21swapper/312:26:153
48367999152,7cyclictest0-21swapper/311:31:143
48367999152,7cyclictest0-21swapper/311:01:133
48367999152,6cyclictest0-21swapper/312:01:093
48367999152,5cyclictest0-21swapper/309:06:073
48367999152,5cyclictest0-21swapper/309:06:073
48367999151,8cyclictest0-21swapper/312:06:163
48367999151,8cyclictest0-21swapper/312:06:163
48367999151,8cyclictest0-21swapper/310:51:133
48367999151,8cyclictest0-21swapper/310:31:103
48367999151,6cyclictest0-21swapper/309:51:073
48367999143,6cyclictest0-21swapper/310:06:153
48367999143,5cyclictest0-21swapper/308:46:123
48367999142,7cyclictest0-21swapper/312:21:183
48367999142,7cyclictest0-21swapper/309:41:173
48367999142,6cyclictest0-21swapper/311:16:113
48367999142,6cyclictest0-21swapper/310:11:113
48367999142,6cyclictest0-21swapper/309:46:133
48367999142,5cyclictest0-21swapper/309:16:083
48367999142,5cyclictest0-21swapper/307:21:093
48367999141,8cyclictest0-21swapper/311:11:133
48367999141,8cyclictest0-21swapper/309:21:173
48367999141,8cyclictest0-21swapper/308:21:123
48367999141,7cyclictest0-21swapper/311:56:093
48367999141,7cyclictest0-21swapper/310:41:093
48367999141,7cyclictest0-21swapper/310:26:033
48367999141,6cyclictest0-21swapper/308:56:103
48367999141,6cyclictest0-21swapper/308:56:103
48367999141,6cyclictest0-21swapper/308:01:133
48367999141,5cyclictest0-21swapper/307:36:093
48367999141,5cyclictest0-21swapper/307:36:093
48367999135,6cyclictest0-21swapper/312:11:133
48367999135,6cyclictest0-21swapper/312:11:133
48367999133,6cyclictest0-21swapper/311:05:593
48367999133,5cyclictest0-21swapper/311:36:143
48367999133,5cyclictest0-21swapper/309:11:113
48367999132,8cyclictest0-21swapper/311:46:123
48367999132,8cyclictest0-21swapper/311:46:123
48367999132,7cyclictest0-21swapper/311:51:113
48367999132,7cyclictest0-21swapper/311:51:113
48367999132,6cyclictest0-21swapper/312:36:023
48367999132,6cyclictest0-21swapper/310:21:083
48367999131,6cyclictest0-21swapper/308:41:083
48367999131,6cyclictest0-21swapper/308:16:083
48367999131,6cyclictest0-21swapper/308:06:093
48367999131,6cyclictest0-21swapper/307:16:113
48367999124,6cyclictest0-21swapper/311:41:123
48367999124,6cyclictest0-21swapper/311:41:123
48367999122,6cyclictest0-21swapper/307:46:093
48367999122,5cyclictest0-21swapper/311:20:593
48367999122,5cyclictest0-21swapper/309:30:583
48367999121,7cyclictest0-21swapper/310:36:133
48367999121,7cyclictest0-21swapper/310:01:023
48367999121,6cyclictest0-21swapper/312:16:083
48367999121,6cyclictest0-21swapper/307:56:083
48367999121,6cyclictest0-21swapper/307:41:123
48367999121,5cyclictest0-21swapper/308:36:093
48367999121,5cyclictest0-21swapper/307:51:083
48367999121,5cyclictest0-21swapper/307:11:083
48367999113,4cyclictest0-21swapper/308:11:123
48367999111,6cyclictest0-21swapper/309:01:003
48367999111,6cyclictest0-21swapper/309:01:003
48367999102,5cyclictest0-21swapper/307:26:073
48367999101,5cyclictest0-21swapper/308:26:093
48367999101,5cyclictest0-21swapper/307:31:103
4836799981,3cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional