You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-15 - 06:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Nov 15, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2513379995444,6cyclictest2546532-21grep20:40:262
2513379995040,6cyclictest2527135-21grep19:45:262
2513383994933,13cyclictest391ktimers/322:00:133
2513383994838,7cyclictest2577882-21grep22:15:003
2513379994739,5cyclictest2625233-21fschecks_time00:30:152
2513379994738,5cyclictest2565268-21unixbench_multi21:35:272
2513379994636,6cyclictest311ktimers/221:25:132
2513370994534,7cyclictest2575703-21grep22:05:250
2513383994328,11cyclictest391ktimers/323:40:133
2513383994231,9cyclictest391ktimers/319:30:143
2513374994234,5cyclictest2576103-21kworker/u8:3+events_unbound22:22:371
2513383994033,4cyclictest2552067-21cron21:00:003
251337499405,4cyclictest131rcu_preempt19:30:131
2513374994029,7cyclictest2528785-21grep19:50:261
2513370994029,7cyclictest0-21swapper/022:00:000
2513383993930,5cyclictest438-21cron21:30:003
2513379993927,6cyclictest0-21swapper/219:55:272
2513383993826,8cyclictest2563594-21grep21:30:263
2513379993826,9cyclictest2519031-21cron19:25:002
2513374993828,6cyclictest0-21swapper/123:20:011
2513374993729,4cyclictest0-21swapper/119:30:001
2513374993722,11cyclictest231ktimers/100:30:131
2513383993629,4cyclictest2572771-21sendmail22:00:003
2513383993628,5cyclictest2565342-21kworker/u8:1+events_unbound21:47:353
2513383993620,12cyclictest2513364-21cyclictest00:05:133
2513379993629,5cyclictest2593627-21kworker/u8:0+events_unbound23:02:412
2513379993625,7cyclictest2549879-21grep20:50:262
251337999361,4cyclictest131rcu_preempt21:20:112
251337999361,4cyclictest131rcu_preempt21:20:102
2513374993630,4cyclictest2534814-21kworker/u8:3+events_unbound20:12:291
2513374993629,4cyclictest0-21swapper/122:20:011
2513374993625,7cyclictest2573218-21fschecks_time22:00:171
2513370993626,7cyclictest2614533-21cron23:59:590
2513379993528,5cyclictest2617588-21kworker/u8:2+events_unbound00:07:432
2513379993528,5cyclictest2577832-21kworker/u8:0+events_unbound22:17:382
2513379993525,7cyclictest2522001-21grep19:30:272
2513379993524,7cyclictest2581057-21grep22:20:242
251337999351,6cyclictest131rcu_preempt20:45:132
2513374993527,5cyclictest208-21systemd-logind21:22:341
2513374993527,5cyclictest208-21systemd-logind21:22:341
2513383993427,5cyclictest2543454-21kworker/u8:0+events_unbound20:37:313
2513383993426,4cyclictest0-21swapper/322:40:273
2513383993426,4cyclictest0-21swapper/320:50:253
2513383993424,6cyclictest0-21swapper/320:45:013
2513379993425,6cyclictest2515002-21auditctl19:15:012
2513379993425,5cyclictest0-21swapper/223:55:162
2513374993427,5cyclictest2609081-21kworker/u8:0+events_unbound23:44:411
2513374993427,4cyclictest2628229-21cron00:40:001
2513374993426,4cyclictest2569143-21idleruntime-cro21:50:011
2513374993426,4cyclictest0-21swapper/120:40:011
2513370993427,4cyclictest2591950-21kthreadd22:55:010
2513383993327,4cyclictest2600417-21kworker/u8:2+events_unbound23:27:423
2513383993325,4cyclictest2514576-21unixbench_singl19:10:253
2513383993323,6cyclictest0-21swapper/320:20:013
2513379993326,4cyclictest2534593-21sh20:10:002
2513379993326,4cyclictest0-21swapper/223:00:012
2513379993325,4cyclictest0-21swapper/223:15:222
2513379993323,6cyclictest0-21swapper/219:50:262
2513379993318,5cyclictest2514974-21kworker/u8:1+events_unbound19:16:072
2513374993322,7cyclictest0-21swapper/122:35:251
251337499331,4cyclictest131rcu_preempt19:45:141
2513370993326,4cyclictest0-21swapper/020:20:010
2513383993224,4cyclictest0-21swapper/323:00:153
2513383993222,8cyclictest438-21cron20:30:003
2513379993223,6cyclictest2577869-21debian-sa122:15:002
2513379993214,4cyclictest2520481-21kworker/u8:0+events_unbound19:41:042
2513374993224,4cyclictest0-21swapper/123:15:011
2513374993224,4cyclictest0-21swapper/120:45:251
2513374993224,4cyclictest0-21swapper/120:05:011
2513374993224,4cyclictest0-21swapper/120:05:011
2513374993224,4cyclictest0-21swapper/100:10:241
2513374993221,7cyclictest2589759-21grep22:45:241
2513370993225,4cyclictest0-21swapper/000:15:240
2513370993224,4cyclictest0-21swapper/023:10:250
2513370993219,8cyclictest2617971-21basename00:10:000
2513383993124,4cyclictest0-21swapper/323:30:153
2513383993122,6cyclictest2581033-21unixbench_multi22:20:253
2513379993123,4cyclictest0-21swapper/223:20:232
2513379993121,6cyclictest0-21swapper/220:05:012
2513379993121,6cyclictest0-21swapper/220:05:012
2513379993120,7cyclictest2538483-21grep20:20:012
251337999311,5cyclictest131rcu_preempt00:35:102
2513374993124,4cyclictest2607528-21sendmail23:40:011
2513374993123,5cyclictest0-21swapper/122:30:271
2513374993123,4cyclictest0-21swapper/100:25:151
2513374993122,4cyclictest0-21swapper/119:55:161
2513370993125,3cyclictest2569383-21latency_hist21:50:020
2513370993123,4cyclictest0-21swapper/023:32:400
2513370993123,4cyclictest0-21swapper/022:20:010
2513370993123,4cyclictest0-21swapper/020:05:000
2513370993123,4cyclictest0-21swapper/020:05:000
2513383993022,4cyclictest0-21swapper/320:30:233
2513383993020,7cyclictest2627767-21grep00:35:243
251337999301,4cyclictest131rcu_preempt21:55:142
251337999301,3cyclictest131rcu_preempt23:05:132
2513374993022,4cyclictest0-21swapper/119:35:141
2513374993021,6cyclictest2605818-21basename23:35:011
2513374993020,7cyclictest2565280-21grep21:35:261
2513374993019,6cyclictest2570636-21grep21:50:271
2513370993022,5cyclictest0-21swapper/023:20:230
2513370993021,6cyclictest0-21swapper/021:10:010
2513370993020,6cyclictest2516842-21grep19:15:250
2513383992922,4cyclictest2558896-21latency_hist21:20:013
2513383992922,4cyclictest0-21swapper/321:40:153
2513383992921,5cyclictest2597290-21munin-plugin-st23:10:003
2513383992921,5cyclictest0-21swapper/323:40:003
2513383992921,4cyclictest0-21swapper/323:10:153
2513383992921,4cyclictest0-21swapper/320:10:263
2513379992922,4cyclictest0-21swapper/222:45:232
2513379992922,4cyclictest0-21swapper/221:20:012
2513379992921,4cyclictest0-21swapper/221:45:142
2513379992920,7cyclictest2520481-21kworker/u8:0+events_unbound19:37:252
2513379992919,6cyclictest2583000-21grep22:25:252
2513379992916,9cyclictest311ktimers/200:10:122
2513374992923,3cyclictest0-21swapper/123:20:201
2513374992922,5cyclictest2555175-21kworker/u8:1+events_unbound21:12:401
2513374992921,4cyclictest0-21swapper/123:45:151
2513374992921,4cyclictest0-21swapper/120:20:001
2513374992919,7cyclictest2594938-21grep23:00:261
2513370992919,7cyclictest2543074-21grep20:30:230
2513383992821,3cyclictest0-21swapper/300:10:253
2513383992820,4cyclictest0-21swapper/323:20:193
2513383992820,4cyclictest0-21swapper/322:50:253
2513383992820,4cyclictest0-21swapper/321:50:273
2513379992822,4cyclictest2623051-21kworker/u8:1+events_unbound00:24:472
2513379992821,3cyclictest0-21swapper/220:55:262
2513379992812,8cyclictest131rcu_preempt23:30:192
251337499284,6cyclictest131rcu_preempt23:55:131
2513374992821,4cyclictest0-21swapper/121:00:251
2513374992821,4cyclictest0-21swapper/119:20:251
2513374992821,3cyclictest0-21swapper/121:40:231
2513374992820,6cyclictest2558597-21kworker/u8:3+events_unbound21:25:211
2513374992819,6cyclictest2542482-21sort20:30:171
2513370992822,3cyclictest13550irq/42-30be0000.ethernet19:35:160
2513370992821,4cyclictest0-21swapper/022:10:250
2513370992821,4cyclictest0-21swapper/000:35:240
2513370992820,4cyclictest0-21swapper/023:20:010
2513383992721,3cyclictest0-21swapper/323:50:013
2513383992719,4cyclictest0-21swapper/319:35:223
2513383992718,6cyclictest0-21swapper/320:00:013
2513383992715,9cyclictest0-21swapper/322:25:163
2513379992721,4cyclictest380-21ntpd23:25:142
2513379992720,5cyclictest2556931-21kworker/u8:2+events_unbound21:12:182
2513379992720,3cyclictest0-21swapper/221:50:242
2513379992720,3cyclictest0-21swapper/200:05:002
2513379992720,3cyclictest0-21swapper/200:04:592
2513379992718,6cyclictest0-21swapper/222:35:012
2513379992718,5cyclictest0-21swapper/200:15:252
251337999271,6cyclictest2598559-21head23:10:242
2513379992716,8cyclictest2545435-21date20:40:012
2513374992720,5cyclictest2588192-21kworker/u8:3+events_unbound22:45:011
2513374992720,5cyclictest2541481-21kworker/u8:2+events_unbound21:05:201
2513374992720,5cyclictest2539831-21kworker/u8:1+events_unbound20:23:421
2513370992723,2cyclictest13550irq/42-30be0000.ethernet23:05:230
2513370992720,4cyclictest13850irq/36-mmc121:45:000
2513370992718,6cyclictest2594404-21missed_timers23:00:190
2513370992716,8cyclictest2570049-21missed_timers21:50:210
2513383992618,4cyclictest2621372-21sendmail00:20:013
2513379992619,5cyclictest2541481-21kworker/u8:2+events_unbound20:30:112
2513374992619,5cyclictest2602271-21kworker/u8:1+events_unbound23:27:371
2513374992619,4cyclictest0-21swapper/100:15:151
2513374992618,6cyclictest2568910-21kworker/u8:2+events_unbound22:25:251
2513374992618,4cyclictest2572268-21grep21:55:261
2513374992616,6cyclictest0-21swapper/123:54:591
2513374992616,6cyclictest0-21swapper/123:05:261
2513374992615,8cyclictest2617069-21ntp_states00:05:221
2513374992615,7cyclictest1-21systemd22:57:381
2513374992610,6cyclictest24-21ksoftirqd/122:10:121
2513370992621,3cyclictest2540220-21latency_hist20:25:010
251337999255,3cyclictest131rcu_preempt19:25:182
2513379992519,3cyclictest0-21swapper/223:50:002
2513379992518,5cyclictest2584801-21kworker/u8:1+events_unbound22:35:542
2513379992518,4cyclictest311ktimers/222:40:372
2513379992517,6cyclictest2610812-21kworker/u8:2+events_unbound23:50:422
2513379992517,5cyclictest0-21swapper/220:15:012
2513379992516,7cyclictest2548515-21kworker/u8:0+events_unbound21:09:322
251337999251,10cyclictest2607758-21/usr/sbin/munin23:40:172
251337499257,10cyclictest24-21ksoftirqd/100:00:151
251337499257,10cyclictest24-21ksoftirqd/100:00:151
2513374992518,4cyclictest2558597-21kworker/u8:3+events_unbound21:31:501
2513374992517,6cyclictest231ktimers/121:15:121
2513374992517,5cyclictest0-21swapper/120:25:261
2513374992517,4cyclictest0-21swapper/119:10:161
2513374992516,5cyclictest0-21swapper/100:25:011
2513370992521,2cyclictest13550irq/42-30be0000.ethernet00:20:100
2513370992519,3cyclictest0-21swapper/020:00:010
251337099251,7cyclictest2536250-21runrttasks20:14:350
251337099251,11cyclictest2513872-21irqstats19:10:170
2513370992510,13cyclictest2550366-21latency_hist20:55:000
2513383992418,4cyclictest2616264-21cron00:05:003
2513383992418,4cyclictest2616264-21cron00:04:593
2513383992418,4cyclictest1-21systemd21:36:403
2513383992416,5cyclictest2600246-21unixbench_singl23:15:233
2513383992416,4cyclictest2527519-21kworker/u8:2+events_unbound19:52:253
2513383992415,6cyclictest0-21swapper/300:20:103
2513379992418,3cyclictest0-21swapper/220:20:172
2513379992413,8cyclictest2606958-21expr23:35:242
251337499247,5cyclictest24-21ksoftirqd/119:40:331
251337499247,10cyclictest24-21ksoftirqd/119:15:121
2513374992417,3cyclictest0-21swapper/120:05:261
251337099246,4cyclictest2593681-21idleruntime-cro23:00:010
2513370992420,2cyclictest13550irq/42-30be0000.ethernet19:20:150
2513370992418,4cyclictest0-21swapper/000:00:270
2513370992418,4cyclictest0-21swapper/000:00:260
2513370992418,3cyclictest0-21swapper/023:55:000
2513370992415,5cyclictest0-21swapper/022:28:060
251337099241,20cyclictest2618541-21cut00:10:180
251337099241,20cyclictest2550755-21/usr/sbin/munin20:55:160
251337099241,19cyclictest0-21swapper/022:24:180
251337099241,19cyclictest0-21swapper/021:27:120
2513383992317,3cyclictest2531912-21mailstats20:00:243
2513383992317,3cyclictest2531912-21mailstats20:00:243
2513383992316,5cyclictest0-21swapper/321:15:013
2513383992315,4cyclictest0-21swapper/320:45:163
2513383992314,7cyclictest391ktimers/323:50:063
2513383992314,6cyclictest2560710-21date21:25:003
2513383992314,6cyclictest2560710-21date21:25:003
2513383992310,9cyclictest0-21swapper/300:30:163
2513379992317,4cyclictest2567143-21kworker/u8:0+events_unbound21:42:372
2513379992316,5cyclictest2568910-21kworker/u8:2+events_unbound22:09:532
2513379992314,6cyclictest0-21swapper/220:25:262
251337499238,4cyclictest131rcu_preempt22:50:111
251337499234,7cyclictest24-21ksoftirqd/120:50:201
2513370992317,4cyclictest0-21swapper/021:15:240
2513370992317,3cyclictest0-21swapper/020:07:400
2513370992316,5cyclictest0-21swapper/022:45:110
2513370992316,3cyclictest0-21swapper/021:31:480
2513370992315,4cyclictest2527556-21latency_hist19:50:010
2513370992315,4cyclictest0-21swapper/023:25:220
2513370992314,6cyclictest0-21swapper/019:50:170
2513370992312,8cyclictest2548669-21munin-plugin-st20:50:010
2513370992311,9cyclictest2513364-21cyclictest23:40:130
251337099231,18cyclictest0-21swapper/023:48:280
251337099231,18cyclictest0-21swapper/021:21:450
251337099231,18cyclictest0-21swapper/021:21:440
251337099231,18cyclictest0-21swapper/019:41:200
2513383992216,3cyclictest0-21swapper/322:55:143
2513383992215,4cyclictest645-21runrttasks22:45:213
2513383992215,4cyclictest0-21swapper/300:25:233
251338399220,7cyclictest0-21swapper/319:40:123
251337999222,3cyclictest131rcu_preempt22:00:272
2513379992213,7cyclictest2553478-21seq21:01:272
251337099226,14cyclictest2606683-21processes23:35:220
2513370992215,3cyclictest0-21swapper/021:03:380
2513370992215,3cyclictest0-21swapper/019:34:500
2513370992214,6cyclictest121ktimers/021:10:120
2513370992214,5cyclictest0-21swapper/000:25:230
2513370992214,4cyclictest0-21swapper/022:30:270
251337099221,19cyclictest0-21swapper/022:42:390
251337099221,19cyclictest0-21swapper/021:38:150
251337099221,18cyclictest2544772-21grep20:35:250
251337099221,17cyclictest0-21swapper/022:37:100
251337099220,18cyclictest0-21swapper/019:29:260
2513383992115,4cyclictest2555175-21kworker/u8:1+events_unbound21:07:343
2513383992115,3cyclictest0-21swapper/322:05:223
2513383992115,3cyclictest0-21swapper/320:05:183
2513383992114,5cyclictest391ktimers/319:27:063
2513383992112,6cyclictest0-21swapper/319:45:253
2513379992115,3cyclictest0-21swapper/222:50:192
251337499215,3cyclictest131rcu_preempt20:55:171
2513374992115,4cyclictest2568910-21kworker/u8:2+events_unbound22:05:341
2513370992115,3cyclictest0-21swapper/022:00:210
2513370992113,5cyclictest0-21swapper/020:40:170
2513370992110,8cyclictest2540713-21/usr/sbin/munin20:25:180
2513383992014,4cyclictest391ktimers/321:01:263
2513383992014,3cyclictest0-21swapper/323:55:133
2513383992014,3cyclictest0-21swapper/319:15:043
2513383992013,5cyclictest391ktimers/319:20:123
2513383992012,5cyclictest2577832-21kworker/u8:0+events_unbound22:35:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional