You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 02:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Apr 21, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2465590995524,5cyclictest0-21swapper/322:12:443
2465590995341,8cyclictest391ktimers/300:00:113
2465590995341,8cyclictest391ktimers/300:00:113
2465590995226,4cyclictest2503655-21kthreadd21:00:013
2465590995126,4cyclictest2519246-21idleruntime-cro21:44:593
2465588995144,5cyclictest2556728-21kworker/u8:2+events_unbound23:42:591
246558899511,16cyclictest24-21ksoftirqd/121:40:131
2465587995120,5cyclictest0-21swapper/021:00:010
2465589994838,7cyclictest2520470-21grep21:45:262
2465589994838,7cyclictest2520470-21grep21:45:262
2465587994720,4cyclictest0-21swapper/021:20:160
2465590994537,5cyclictest2537523-21unixbench_multi22:35:293
2465590994537,5cyclictest2537523-21unixbench_multi22:35:293
2465588994534,6cyclictest2572326-21sendmail00:20:011
2465590994437,4cyclictest2524338-21sh21:59:593
2465589994336,4cyclictest2517535-21sendmail21:40:002
2465587994219,5cyclictest0-21swapper/019:50:280
2465590994129,9cyclictest2476393-21sendmail19:40:013
2465589994131,6cyclictest2527287-21grep22:05:252
2465588994131,6cyclictest2494679-21unixbench_multi20:30:291
2465590994032,5cyclictest2527764-21ls22:10:003
2465589994031,4cyclictest0-21swapper/221:45:002
2465590993930,7cyclictest438-21cron19:50:003
2465587993932,4cyclictest2517099-21unixbench_singl21:35:250
2465589993831,4cyclictest2539707-21idleruntime-cro22:45:002
2465589993831,4cyclictest2539707-21idleruntime-cro22:45:002
2465589993831,4cyclictest0-21swapper/219:25:252
2465589993829,6cyclictest2492132-21fschecks_count20:25:162
2465589993828,6cyclictest0-21swapper/223:40:002
2465590993626,7cyclictest2494679-21unixbench_multi20:30:293
2465590993626,6cyclictest2551394-21grep23:15:283
2465590993623,10cyclictest391ktimers/322:25:143
2465589993629,3cyclictest0-21swapper/223:05:252
2465589993627,6cyclictest0-21swapper/200:00:002
2465589993626,6cyclictest0-21swapper/222:00:002
2465589993625,8cyclictest2554825-21grep23:25:272
2465588993627,5cyclictest2553141-21seq23:20:251
2465588993625,6cyclictest0-21swapper/123:40:001
2465589993529,3cyclictest0-21swapper/221:20:012
2465589993526,6cyclictest2534124-21grep22:25:272
2465589993525,7cyclictest311ktimers/223:50:132
2465590993427,4cyclictest0-21swapper/323:45:003
2465589993426,4cyclictest2490019-21latency_hist20:20:002
2465589993426,4cyclictest2490019-21latency_hist20:20:002
2465589993426,4cyclictest0-21swapper/222:37:482
2465589993426,4cyclictest0-21swapper/222:37:482
246558899343,6cyclictest131rcu_preempt00:25:121
2465588993428,4cyclictest2493440-21munin-plugin-st20:29:591
2465587993424,6cyclictest0-21swapper/023:00:010
2465587993423,7cyclictest2524337-21auditctl21:59:590
2465590993325,4cyclictest2478100-21munin-plugin-st19:45:013
2465590993325,4cyclictest0-21swapper/300:18:053
2465590993324,5cyclictest0-21swapper/320:05:173
2465590993323,6cyclictest0-21swapper/321:25:173
2465589993324,6cyclictest2559143-21tune2fs23:40:162
2465589993323,6cyclictest2515397-21grep21:30:262
2465588993327,4cyclictest2550361-21kworker/u8:4+events_unbound23:28:081
2465588993324,6cyclictest2531165-21auditctl22:20:011
2465588993324,5cyclictest0-21swapper/121:45:261
2465588993324,5cyclictest0-21swapper/121:45:261
2465590993226,3cyclictest0-21swapper/320:40:013
2465590993225,4cyclictest0-21swapper/320:00:283
2465590993223,6cyclictest2507068-21sh21:10:013
2465590993219,9cyclictest391ktimers/323:25:133
2465589993224,4cyclictest0-21swapper/222:15:162
2465589993223,5cyclictest2549963-21latency_hist23:15:012
2465589993222,6cyclictest0-21swapper/223:15:282
2465588993219,9cyclictest0-21swapper/121:55:161
2465587993224,4cyclictest0-21swapper/022:25:170
2465590993125,3cyclictest0-21swapper/320:50:233
2465590993124,4cyclictest0-21swapper/322:00:263
2465590993124,4cyclictest0-21swapper/300:10:263
2465589993125,3cyclictest0-21swapper/220:10:262
246558899313,4cyclictest131rcu_preempt22:55:121
2465588993124,5cyclictest2511513-21kworker/u8:1+events_unbound21:22:321
2465588993123,4cyclictest0-21swapper/119:50:281
2465587993124,4cyclictest0-21swapper/000:28:070
2465587993123,4cyclictest0-21swapper/023:50:000
2465587993121,6cyclictest0-21swapper/020:20:000
2465587993121,6cyclictest0-21swapper/020:20:000
2465590993023,4cyclictest0-21swapper/300:30:253
2465590993022,5cyclictest0-21swapper/323:50:003
2465590993020,7cyclictest0-21swapper/320:45:003
2465590993020,6cyclictest0-21swapper/319:20:263
2465590993020,6cyclictest0-21swapper/300:35:283
2465590993019,8cyclictest1-21systemd21:12:293
2465589993023,3cyclictest0-21swapper/200:10:252
2465589993021,6cyclictest2560842-21grep23:45:152
2465588993024,4cyclictest2472952-21kworker/u8:2+events_unbound20:50:411
2465588993022,4cyclictest0-21swapper/119:15:251
2465588993021,5cyclictest0-21swapper/100:08:031
2465588993019,6cyclictest0-21swapper/121:40:001
2465587993024,3cyclictest0-21swapper/022:50:000
2465587993022,5cyclictest0-21swapper/021:45:000
2465587993022,4cyclictest0-21swapper/022:35:010
2465587993021,6cyclictest0-21swapper/021:30:160
2465587993021,5cyclictest0-21swapper/019:30:010
2465590992921,4cyclictest0-21swapper/323:07:533
2465589992921,5cyclictest0-21swapper/221:05:252
2465589992920,5cyclictest0-21swapper/222:25:012
2465589992919,6cyclictest0-21swapper/221:10:262
2465589992918,9cyclictest311ktimers/200:05:122
2465588992922,5cyclictest2541376-21kworker/u8:0+events_unbound23:07:551
2465588992921,4cyclictest0-21swapper/100:20:271
2465588992918,7cyclictest0-21swapper/123:00:261
2465588992917,8cyclictest2496853-21sendmail20:40:011
2465587992922,3cyclictest0-21swapper/021:10:160
2465587992920,6cyclictest2520472-21unixbench_multi21:45:260
2465587992920,6cyclictest2520472-21unixbench_multi21:45:260
2465587992918,7cyclictest0-21swapper/021:30:010
2465590992821,4cyclictest0-21swapper/323:10:263
2465589992820,4cyclictest0-21swapper/200:35:282
2465589992817,7cyclictest2501538-21grep20:50:222
2465588992817,8cyclictest2562069-21cron23:49:591
246558899281,4cyclictest131rcu_preempt21:50:121
246558899281,4cyclictest131rcu_preempt21:50:111
2465587992822,4cyclictest2553664-21latency_hist23:25:010
2465587992821,4cyclictest0-21swapper/023:05:000
2465587992820,5cyclictest0-21swapper/019:30:250
2465587992820,4cyclictest0-21swapper/000:30:250
2465587992819,6cyclictest0-21swapper/022:45:000
2465587992819,6cyclictest0-21swapper/022:44:590
2465590992721,3cyclictest0-21swapper/322:50:003
2465590992714,10cyclictest391ktimers/320:25:123
2465589992722,3cyclictest2514115-21kthreadd21:30:012
2465589992721,3cyclictest2477726-21kworker/u8:3-ext4-rsv-conversion19:50:012
2465589992720,5cyclictest2465118-21kworker/u8:3+events_unbound19:22:142
2465589992719,4cyclictest0-21swapper/200:30:252
246558899276,5cyclictest24-21ksoftirqd/100:15:011
2465588992720,5cyclictest2539594-21kworker/u8:3+events_unbound22:44:401
2465588992720,5cyclictest2539594-21kworker/u8:3+events_unbound22:44:401
2465588992718,6cyclictest2578663-21grep00:35:271
2465587992721,3cyclictest0-21swapper/020:00:010
2465587992720,3cyclictest0-21swapper/023:20:010
2465590992620,3cyclictest0-21swapper/321:35:013
2465590992619,4cyclictest2487912-21head20:10:263
2465590992619,4cyclictest0-21swapper/323:50:263
2465590992619,4cyclictest0-21swapper/323:20:243
2465590992618,4cyclictest0-21swapper/320:20:263
2465590992617,6cyclictest2480412-21sort19:50:213
2465589992621,3cyclictest2572044-21sh00:17:012
2465589992619,5cyclictest164-21systemd-journal22:56:402
2465589992618,4cyclictest2536281-21sh22:35:002
2465589992616,7cyclictest2543095-21cron22:55:002
2465589992616,6cyclictest2528992-21grep22:10:262
2465588992620,4cyclictest2548141-21kworker/u8:1+events_unbound00:30:571
2465588992620,3cyclictest0-21swapper/122:35:191
2465588992620,3cyclictest0-21swapper/122:35:181
2465588992619,5cyclictest2496584-21kworker/u8:0+events_unbound21:15:241
2465588992619,5cyclictest2496584-21kworker/u8:0+events_unbound21:10:221
2465588992619,4cyclictest0-21swapper/120:45:261
2465588992619,4cyclictest0-21swapper/119:25:261
2465588992617,5cyclictest0-21swapper/120:20:171
246558899261,5cyclictest131rcu_preempt23:15:131
2465587992620,4cyclictest2550080-21apt-key23:15:010
2465587992618,4cyclictest0-21swapper/023:55:150
2465587992614,7cyclictest2479334-21grep19:45:240
2465587992613,10cyclictest2494274-21awk20:30:260
246558799261,10cyclictest2510719-21grep21:20:010
2465590992520,3cyclictest0-21swapper/322:20:013
2465590992518,4cyclictest0-21swapper/323:35:153
2465590992518,4cyclictest0-21swapper/323:30:163
2465590992518,4cyclictest0-21swapper/300:25:163
2465590992516,6cyclictest2531508-21awk22:20:143
2465590992515,7cyclictest2474638-21seq19:34:483
2465589992519,3cyclictest0-21swapper/220:40:142
2465589992518,4cyclictest2573553-21grep00:20:272
246558899255,4cyclictest131rcu_preempt22:00:121
246558899252,3cyclictest131rcu_preempt21:34:381
2465588992518,5cyclictest2496584-21kworker/u8:0+events_unbound20:44:551
2465588992518,5cyclictest2472952-21kworker/u8:2+events_unbound20:12:271
2465588992518,4cyclictest0-21swapper/121:25:261
2465588992516,6cyclictest0-21swapper/122:05:171
2465588992516,5cyclictest0-21swapper/119:10:251
2465588992513,8cyclictest2507097-21http21:10:011
2465587992519,3cyclictest0-21swapper/023:40:000
2465587992519,3cyclictest0-21swapper/023:10:010
2465587992519,3cyclictest0-21swapper/019:10:260
2465587992519,3cyclictest0-21swapper/000:40:000
2465587992517,5cyclictest2475961-21head19:35:260
2465587992517,4cyclictest2560372-21sh23:45:000
2465587992516,6cyclictest2532893-21basename22:25:000
2465587992516,5cyclictest0-21swapper/000:15:010
2465587992515,7cyclictest2499309-21ntp_kernel_err20:45:200
2465587992513,9cyclictest2568394-21cat00:05:250
246558799251,21cyclictest2554700-21date23:25:260
246558799251,20cyclictest0-21swapper/022:38:000
246558799251,20cyclictest0-21swapper/022:38:000
2465590992418,3cyclictest0-21swapper/320:15:253
2465590992418,3cyclictest0-21swapper/320:15:243
2465590992418,3cyclictest0-21swapper/319:15:003
2465590992415,5cyclictest2520471-21tail21:45:263
2465590992415,5cyclictest2520471-21tail21:45:263
2465590992414,7cyclictest2536293-21pluginstate22:35:013
2465589992417,5cyclictest208-21systemd-logind00:26:402
2465589992417,3cyclictest0-21swapper/200:05:002
2465589992417,3cyclictest0-21swapper/200:04:592
2465589992415,6cyclictest2469025-21ls19:15:252
2465589992413,7cyclictest0-21swapper/223:25:002
2465588992419,3cyclictest2550361-21kworker/u8:4-events_freezable_power_23:30:261
2465588992418,4cyclictest2548141-21kworker/u8:1+events_unbound23:58:211
2465588992418,4cyclictest2539594-21kworker/u8:3+events_unbound22:45:431
2465588992418,4cyclictest2472952-21kworker/u8:2+events_unbound20:08:311
2465588992417,5cyclictest2536508-21kworker/u8:2+events_unbound23:12:311
2465588992416,4cyclictest0-21swapper/123:55:001
2465588992412,8cyclictest2474675-21basename19:35:011
246558799243,2cyclictest0-21swapper/020:05:150
2465587992418,3cyclictest2573098-21ntpq00:20:220
2465587992417,3cyclictest0-21swapper/022:11:520
2465587992417,3cyclictest0-21swapper/019:44:390
2465587992415,6cyclictest2492913-21cat20:25:260
2465587992414,7cyclictest2569271-21awk00:10:160
2465587992414,7cyclictest2530194-21sed22:15:200
2465587992414,7cyclictest2502054-21cat20:55:010
2465587992414,7cyclictest2468598-21awk19:15:190
246558799241,19cyclictest0-21swapper/021:53:100
246558799241,19cyclictest0-21swapper/021:53:100
246558799241,19cyclictest0-21swapper/020:21:350
246558799241,19cyclictest0-21swapper/020:12:310
246558799241,19cyclictest0-21swapper/020:03:280
2465590992317,3cyclictest0-21swapper/300:20:143
2465590992317,3cyclictest0-21swapper/300:00:003
2465590992316,5cyclictest164-21systemd-journal00:06:403
2465590992315,5cyclictest2521870-21cat21:50:243
2465590992315,5cyclictest2521870-21cat21:50:243
2465590992313,7cyclictest2516048-21apt-get21:35:113
246558999232,11cyclictest645-21runrttasks20:33:472
2465589992315,6cyclictest2541376-21kworker/u8:0+events_unbound23:02:572
2465589992315,6cyclictest164-21systemd-journal19:51:402
2465589992315,4cyclictest0-21swapper/220:35:172
2465589992313,6cyclictest2540920-21grep22:45:222
246558899239,6cyclictest24-21ksoftirqd/119:45:141
246558899235,3cyclictest131rcu_preempt00:00:111
246558899235,3cyclictest131rcu_preempt00:00:111
246558899235,13cyclictest2533352-21grep22:25:181
2465588992317,4cyclictest2470103-21kworker/u8:1+events_unbound19:40:531
2465588992317,3cyclictest0-21swapper/122:20:211
2465588992316,4cyclictest380-21ntpd21:00:201
2465588992315,5cyclictest0-21swapper/120:55:251
2465588992314,7cyclictest2472952-21kworker/u8:2+events_unbound20:17:061
2465588992314,7cyclictest2472952-21kworker/u8:2+events_unbound20:17:061
2465587992316,3cyclictest2506605-21tail21:05:250
2465587992316,3cyclictest0-21swapper/020:42:520
246558799231,20cyclictest0-21swapper/021:00:110
246558799230,19cyclictest0-21swapper/022:07:390
246558799230,19cyclictest0-21swapper/019:21:060
246559099229,11cyclictest391ktimers/320:45:163
2465590992216,3cyclictest0-21swapper/321:00:183
2465590992214,6cyclictest2510751-21cut21:20:013
2465590992214,5cyclictest0-21swapper/321:20:263
2465589992216,3cyclictest0-21swapper/221:20:132
2465589992216,3cyclictest0-21swapper/220:50:012
2465589992216,3cyclictest0-21swapper/219:10:172
2465589992215,4cyclictest2478088-21auditctl19:45:012
2465589992213,6cyclictest2474656-21cron19:35:012
246558899222,11cyclictest2458219-21kworker/1:2-mm_percpu_wq22:13:331
2465588992212,6cyclictest0-21swapper/119:55:161
2465587992213,7cyclictest2566200-21ls00:00:220
2465587992213,7cyclictest2566200-21ls00:00:220
2465587992213,6cyclictest2563157-21awk23:50:250
246558799221,19cyclictest0-21swapper/022:50:420
246558799221,19cyclictest0-21swapper/022:01:040
246558799220,18cyclictest0-21swapper/023:33:110
246559099213,5cyclictest0-21swapper/323:00:123
2465590992115,3cyclictest0-21swapper/319:25:173
2465590992114,5cyclictest391ktimers/322:50:163
2465590992114,5cyclictest208-21systemd-logind22:41:403
2465590992114,5cyclictest208-21systemd-logind22:41:393
2465590992113,5cyclictest2544723-21seq22:59:043
2465590992113,5cyclictest2469088-21grep19:15:253
2465589992115,4cyclictest178-21systemd-udevd21:04:402
2465589992115,3cyclictest2486180-21grep20:05:262
2465589992115,3cyclictest0-21swapper/221:50:202
2465589992115,3cyclictest0-21swapper/221:50:202
2465589992115,3cyclictest0-21swapper/220:00:282
2465589992113,6cyclictest311ktimers/219:59:432
2465589992113,4cyclictest438-21cron20:25:002
2465588992115,3cyclictest2483563-21sh20:00:151
2465588992114,5cyclictest2529232-21kworker/u8:0+events_unbound22:33:161
246558999203,13cyclictest2475887-21grep19:35:262
2465589992014,3cyclictest0-21swapper/223:30:212
246558899201,4cyclictest131rcu_preempt19:20:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional