You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-08 - 12:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Jul 08, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
495636995026,4cyclictest499566-21kthreadd19:20:001
495631994738,4cyclictest523680-21munin-plugin-st20:30:000
495643994435,6cyclictest391ktimers/320:00:113
495640994334,5cyclictest511033-21runrttasks19:50:242
495640994334,4cyclictest0-21swapper/223:35:262
495636994335,5cyclictest521964-21cron20:25:001
495631994334,6cyclictest609580-21cron00:40:000
495631994230,7cyclictest0-21swapper/021:35:000
495643994127,10cyclictest391ktimers/322:00:133
495643994127,10cyclictest391ktimers/322:00:133
495636994132,5cyclictest595932-21cron00:00:001
495636994132,5cyclictest595932-21cron00:00:001
495643994030,6cyclictest0-21swapper/322:00:003
495643994027,8cyclictest523076-21timerandwakeup20:25:233
495643994027,8cyclictest0-21swapper/321:20:013
495640994032,6cyclictest311ktimers/223:40:122
495640994032,4cyclictest552872-21sh21:54:592
495643993932,4cyclictest0-21swapper/323:20:143
495643993927,7cyclictest597194-21grep00:00:333
495640993932,3cyclictest0-21swapper/223:00:002
495640993931,6cyclictest311ktimers/220:40:132
495643993827,8cyclictest391ktimers/322:10:113
495631993832,3cyclictest564363-21unixbench_multi22:25:260
495631993831,4cyclictest502992-21idleruntime-cro19:30:000
495636993727,6cyclictest575050-21cron23:00:001
495643993628,4cyclictest0-21swapper/322:25:013
495643993626,7cyclictest507642-21grep19:40:253
495643993625,7cyclictest602795-21idleruntime-cro00:20:013
495640993626,6cyclictest0-21swapper/221:35:002
495640993625,7cyclictest0-21swapper/220:00:222
495631993627,6cyclictest535607-21cron21:05:010
495631993626,7cyclictest600589-21grep00:10:250
495643993526,4cyclictest0-21swapper/320:55:013
495643993525,6cyclictest0-21swapper/323:25:253
495643993524,7cyclictest0-21swapper/323:20:003
495643993522,9cyclictest604016-21grep00:20:233
495636993527,4cyclictest0-21swapper/100:31:531
495631993527,4cyclictest0-21swapper/019:19:590
495643993426,4cyclictest0-21swapper/323:45:163
495643993426,4cyclictest0-21swapper/323:35:263
495643993426,4cyclictest0-21swapper/321:05:253
495643993425,6cyclictest0-21swapper/321:50:013
495640993423,7cyclictest607418-21grep00:30:252
495640993423,7cyclictest557996-21apt22:10:002
495640993422,7cyclictest0-21swapper/200:00:332
495640993421,10cyclictest311ktimers/221:05:102
495636993427,4cyclictest0-21swapper/123:05:001
495631993428,3cyclictest0-21swapper/022:50:000
495631993427,4cyclictest0-21swapper/020:30:270
495631993424,6cyclictest530493-21sh20:50:010
495631993423,7cyclictest0-21swapper/022:20:010
495643993326,4cyclictest0-21swapper/322:55:253
495643993325,4cyclictest0-21swapper/322:30:253
495640993324,5cyclictest604061-21grep00:20:232
495640993324,5cyclictest0-21swapper/219:15:002
495640993324,5cyclictest0-21swapper/219:15:002
495636993325,5cyclictest518537-21cron20:15:001
495636993325,5cyclictest518537-21cron20:15:001
495636993325,4cyclictest0-21swapper/122:25:151
495631993323,6cyclictest0-21swapper/019:45:280
495631993317,10cyclictest13850irq/36-mmc122:05:090
495643993225,4cyclictest595954-21munin-plugin-st00:00:003
495643993225,4cyclictest595954-21munin-plugin-st00:00:003
495643993225,3cyclictest0-21swapper/319:45:163
495643993224,4cyclictest0-21swapper/321:50:253
495643993223,5cyclictest0-21swapper/322:05:243
495643993222,7cyclictest598933-21unixbench_singl00:05:253
495643993222,6cyclictest0-21swapper/320:00:013
495643993221,7cyclictest0-21swapper/300:10:153
495640993223,4cyclictest0-21swapper/221:11:332
495640993221,8cyclictest551219-21sort21:50:012
495640993221,7cyclictest605730-21grep00:25:272
495636993224,4cyclictest0-21swapper/120:00:011
495636993223,4cyclictest0-21swapper/120:55:391
495631993225,4cyclictest595939-21kthreadd00:00:000
495631993225,4cyclictest595939-21kthreadd00:00:000
495631993224,4cyclictest0-21swapper/021:00:010
495643993123,4cyclictest573339-21sh22:55:003
495640993124,3cyclictest0-21swapper/221:35:172
495640993124,3cyclictest0-21swapper/219:20:002
495640993123,4cyclictest583590-21kthreadd23:25:002
495640993120,8cyclictest578476-21munin-plugin-st23:10:002
495640993120,7cyclictest602761-21cron00:20:012
495636993124,3cyclictest0-21swapper/123:10:251
495631993123,4cyclictest0-21swapper/019:30:260
495631993112,16cyclictest589118-21sh23:40:000
495643993023,3cyclictest0-21swapper/320:20:003
495643993023,3cyclictest0-21swapper/320:20:003
495643993022,4cyclictest530499-21latency_hist20:50:013
495643993022,4cyclictest0-21swapper/321:25:003
495643993020,6cyclictest0-21swapper/322:45:293
495640993024,4cyclictest566200-21kworker/u8:1+events_unbound22:31:452
495640993023,4cyclictest0-21swapper/221:15:172
495640993022,4cyclictest0-21swapper/222:20:262
495640993022,4cyclictest0-21swapper/219:30:262
495640993021,6cyclictest0-21swapper/200:35:252
495640993021,4cyclictest0-21swapper/219:25:002
495640993020,7cyclictest311ktimers/221:25:132
495640993020,6cyclictest0-21swapper/222:40:242
495636993021,5cyclictest0-21swapper/123:20:241
495631993023,4cyclictest0-21swapper/021:55:260
495631993023,3cyclictest0-21swapper/000:20:010
495631993022,4cyclictest0-21swapper/020:45:000
495631993021,5cyclictest0-21swapper/021:30:000
495643992923,4cyclictest560997-21grep22:15:283
495643992921,4cyclictest0-21swapper/320:30:273
495640992923,4cyclictest504423-21kworker/u8:1+events_unbound19:45:242
495640992922,5cyclictest593878-21kworker/u8:2+events_unbound00:10:232
495640992922,3cyclictest0-21swapper/219:35:262
495640992921,5cyclictest0-21swapper/219:45:012
495640992920,5cyclictest0-21swapper/223:20:002
495640992920,5cyclictest0-21swapper/220:10:172
495640992920,5cyclictest0-21swapper/220:10:172
495636992921,5cyclictest550970-21munin-plugin-st21:50:001
495636992919,6cyclictest0-21swapper/121:00:161
495636992919,6cyclictest0-21swapper/100:25:271
495636992919,5cyclictest0-21swapper/100:20:011
495631992922,3cyclictest0-21swapper/022:40:250
495631992916,8cyclictest0-21swapper/020:00:240
495643992821,5cyclictest521854-21kworker/u8:1+events_unbound21:01:353
495643992819,4cyclictest0-21swapper/300:30:163
495640992822,3cyclictest0-21swapper/223:34:592
495640992821,3cyclictest0-21swapper/222:00:002
495636992821,3cyclictest589116-21kthreadd23:40:001
495636992820,4cyclictest0-21swapper/123:40:241
495636992819,6cyclictest507640-21unixbench_multi19:40:251
495636992817,7cyclictest0-21swapper/121:05:251
495631992821,3cyclictest0-21swapper/022:40:010
495631992821,3cyclictest0-21swapper/019:10:150
495631992821,3cyclictest0-21swapper/019:10:150
495631992819,6cyclictest579740-21unixbench_singl23:10:260
495643992721,3cyclictest576283-21unixbench_multi23:00:253
495643992719,4cyclictest609111-21tail00:35:253
495643992719,4cyclictest0-21swapper/323:50:163
495643992718,6cyclictest504694-21basename19:35:003
495643992717,7cyclictest511238-21grep19:50:253
495640992721,3cyclictest0-21swapper/200:05:252
495640992719,6cyclictest521854-21kworker/u8:1+events_unbound21:21:352
495640992719,4cyclictest0-21swapper/222:45:172
495640992718,6cyclictest0-21swapper/220:05:252
495640992717,7cyclictest561411-21run-parts22:20:012
495636992720,3cyclictest0-21swapper/120:20:001
495636992720,3cyclictest0-21swapper/120:19:591
495636992719,5cyclictest231ktimers/122:12:031
495636992719,4cyclictest0-21swapper/121:50:251
495636992718,5cyclictest0-21swapper/122:16:431
495636992718,4cyclictest0-21swapper/121:10:261
495636992716,7cyclictest1-21systemd20:01:251
495631992721,3cyclictest0-21swapper/019:45:010
495631992720,4cyclictest0-21swapper/021:45:250
495631992717,7cyclictest501280-21sh19:25:000
49563199270,3cyclictest0-21swapper/020:35:130
495643992620,3cyclictest0-21swapper/300:25:203
495643992618,4cyclictest0-21swapper/322:35:153
495643992617,6cyclictest0-21swapper/321:30:003
495640992619,4cyclictest524936-21grep20:30:272
495636992619,5cyclictest178-21systemd-udevd22:00:401
495636992619,5cyclictest178-21systemd-udevd22:00:401
495636992619,5cyclictest164-21systemd-journal20:50:401
495636992619,5cyclictest164-21systemd-journal19:32:401
495636992618,4cyclictest0-21swapper/122:40:151
495636992618,4cyclictest0-21swapper/122:20:261
495636992617,7cyclictest231ktimers/121:30:131
495636992617,5cyclictest0-21swapper/100:35:251
495636992616,7cyclictest587383-21latency_hist23:35:011
495636992616,6cyclictest592111-21unixbench_singl23:45:251
495631992619,4cyclictest121ktimers/020:52:230
495631992619,3cyclictest0-21swapper/000:35:000
495631992618,5cyclictest547572-21sendmail-msp21:40:000
495631992617,5cyclictest0-21swapper/021:20:010
495643992518,4cyclictest0-21swapper/319:26:223
495643992511,5cyclictest569870-21kworker/u8:2+events_unbound23:12:143
495640992518,3cyclictest0-21swapper/222:10:152
495640992517,4cyclictest573340-21sh22:55:002
495636992517,4cyclictest0-21swapper/122:05:231
49563199254,17cyclictest583614-21latency_hist23:25:000
495631992519,4cyclictest518323-21kworker/u8:1+events_unbound20:16:280
495631992519,4cyclictest518323-21kworker/u8:1+events_unbound20:16:280
495631992518,4cyclictest0-21swapper/022:50:140
495631992515,6cyclictest0-21swapper/021:25:000
495631992514,8cyclictest0-21swapper/023:30:130
495643992418,4cyclictest527314-21kworker/u8:2+events_unbound20:41:293
495643992418,4cyclictest520098-21kworker/u8:2+events_unbound20:23:423
495643992416,5cyclictest391ktimers/322:42:223
495643992416,5cyclictest0-21swapper/323:05:263
495643992415,5cyclictest0-21swapper/320:05:163
495643992414,6cyclictest505931-21grep19:35:263
495640992417,4cyclictest311ktimers/220:45:382
495640992417,4cyclictest0-21swapper/223:10:252
495640992417,3cyclictest0-21swapper/223:45:252
495636992418,3cyclictest581618-21sh23:17:001
495636992417,5cyclictest208-21systemd-logind19:20:401
495636992417,3cyclictest0-21swapper/121:20:271
495636992416,5cyclictest0-21swapper/121:20:011
495636992415,4cyclictest0-21swapper/120:40:241
495636992414,6cyclictest0-21swapper/121:30:001
495631992417,4cyclictest0-21swapper/021:05:250
495631992416,5cyclictest602686-21kworker/u8:1+events_unbound00:20:420
49563199241,4cyclictest576999-21apt-get23:05:130
495631992414,6cyclictest0-21swapper/020:20:250
49563199241,19cyclictest0-21swapper/023:50:110
49563199241,19cyclictest0-21swapper/023:17:390
49563199241,19cyclictest0-21swapper/021:52:030
495643992317,3cyclictest0-21swapper/321:35:263
495643992315,5cyclictest0-21swapper/323:40:243
495643992315,4cyclictest0-21swapper/320:55:393
495640992317,3cyclictest0-21swapper/220:50:162
495640992316,4cyclictest521075-21ntpq20:20:222
495640992315,5cyclictest529983-21kworker/u8:0+events_unbound20:55:322
49563699234,3cyclictest131rcu_preempt19:25:261
495636992317,3cyclictest0-21swapper/100:15:011
495636992316,5cyclictest164-21systemd-journal19:50:401
495636992316,4cyclictest438-21cron22:55:001
495636992315,4cyclictest0-21swapper/120:30:171
495636992314,6cyclictest0-21swapper/121:40:161
495636992312,7cyclictest553573-21missed_timers21:55:201
495631992319,2cyclictest13550irq/42-30be0000.ethernet22:10:200
495631992316,5cyclictest0-21swapper/019:53:040
495631992316,3cyclictest0-21swapper/023:28:520
495631992316,3cyclictest0-21swapper/022:30:250
495631992316,3cyclictest0-21swapper/020:06:150
495631992314,5cyclictest0-21swapper/022:55:240
49563199231,20cyclictest0-21swapper/023:02:390
49563199230,19cyclictest0-21swapper/022:22:060
495643992217,3cyclictest501346-21latency_hist19:25:013
495643992216,4cyclictest507891-21kworker/u8:0+events_unbound20:11:273
495643992216,4cyclictest507891-21kworker/u8:0+events_unbound20:11:273
495643992215,4cyclictest563889-21ntpq22:25:213
495643992214,5cyclictest0-21swapper/321:45:013
495640992216,3cyclictest0-21swapper/223:00:152
495640992216,3cyclictest0-21swapper/220:25:182
495640992215,5cyclictest567927-21kworker/u8:2+events_unbound22:36:452
495640992214,6cyclictest555784-21sed22:00:272
495640992214,6cyclictest555784-21sed22:00:272
495640992211,7cyclictest513446-21tr20:00:012
495636992216,3cyclictest0-21swapper/122:45:261
495636992215,5cyclictest164-21systemd-journal23:08:401
495636992215,5cyclictest164-21systemd-journal21:38:401
495636992215,5cyclictest164-21systemd-journal19:12:401
495636992215,5cyclictest164-21systemd-journal19:12:401
495636992215,4cyclictest0-21swapper/119:45:271
495636992215,3cyclictest0-21swapper/123:25:251
495636992214,5cyclictest0-21swapper/119:35:261
495636992213,6cyclictest231ktimers/100:05:001
49563199221,3cyclictest0-21swapper/019:37:430
495631992212,6cyclictest0-21swapper/022:00:270
495631992212,6cyclictest0-21swapper/022:00:270
49563199221,17cyclictest0-21swapper/021:41:420
49563199220,18cyclictest0-21swapper/000:27:100
495643992115,4cyclictest526234-21wc20:35:233
495643992115,2cyclictest0-21swapper/319:20:013
495643992114,5cyclictest521854-21kworker/u8:1+events_unbound21:10:213
495643992114,3cyclictest0-21swapper/323:30:133
49564099212,15cyclictest593808-21grep23:50:262
495640992115,3cyclictest0-21swapper/223:30:012
495640992114,4cyclictest0-21swapper/220:15:242
495640992114,4cyclictest0-21swapper/220:15:242
495640992112,6cyclictest564826-21munin-run22:30:012
495640992111,7cyclictest526169-21/usr/sbin/munin20:35:212
495640992110,8cyclictest501518-21apt-get19:25:132
495636992114,5cyclictest208-21systemd-logind20:45:401
495636992114,4cyclictest0-21swapper/122:35:241
495636992114,4cyclictest0-21swapper/122:30:201
495636992111,6cyclictest0-21swapper/120:40:001
495636992110,7cyclictest1-21systemd00:06:531
495631992114,4cyclictest513425-21latency_hist20:00:010
49563199211,3cyclictest0-21swapper/020:10:030
49563199211,3cyclictest0-21swapper/020:10:030
49563199211,18cyclictest0-21swapper/023:43:300
49563199211,18cyclictest0-21swapper/021:11:010
49563199211,18cyclictest0-21swapper/000:06:450
495640992014,3cyclictest0-21swapper/223:55:152
495640992014,3cyclictest0-21swapper/223:55:142
495636992014,3cyclictest0-21swapper/120:05:251
495636992013,4cyclictest604628-21latency_hist00:25:011
495643991913,3cyclictest0-21swapper/321:30:143
495636991913,3cyclictest523811-21latency_hist20:30:011
495643991812,3cyclictest495782-21/usr/sbin/munin19:10:123
495643991812,3cyclictest495782-21/usr/sbin/munin19:10:123
495636991811,5cyclictest231ktimers/123:50:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional