You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 11:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Dec 25, 2025 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2457841994837,7cyclictest2509509-21grep21:35:263
2457838994736,7cyclictest2521934-21cron22:15:010
2457839994638,6cyclictest2570321-21kworker/u8:2+events_unbound00:38:581
245784199453,9cyclictest2518098-21head22:00:263
2457841994515,4cyclictest438-21cron22:30:003
2457839994539,4cyclictest2515066-21kworker/u8:1+events_unbound22:07:201
2457840994434,6cyclictest2464962-21grep19:25:242
2457839994426,9cyclictest131rcu_preempt23:20:201
2457841994331,9cyclictest391ktimers/322:20:123
2457841994320,20cyclictest2521447-21grep22:10:243
2457841994316,24cyclictest2554332-21head23:45:253
2457838994335,4cyclictest2465874-21fschecks_time19:30:150
2457838994334,4cyclictest0-21swapper/020:30:000
2457841994230,8cyclictest391ktimers/320:05:163
2457841994215,22cyclictest0-21swapper/322:30:193
2457841994213,4cyclictest2505934-21grep21:25:253
2457841994211,9cyclictest2475665-21ls20:00:013
245784199421,10cyclictest2551400-21cat23:40:013
2457840994227,6cyclictest2472159-21kworker/u8:2+events_unbound19:55:212
245784199417,6cyclictest0-21swapper/300:35:003
2457841994129,8cyclictest2471842-21grep19:45:263
245784199412,8cyclictest2501254-21grep21:15:013
245784199412,12cyclictest2482507-21awk20:20:003
245784199412,12cyclictest2482507-21awk20:20:003
2457841994116,21cyclictest0-21swapper/319:30:153
2457840994133,5cyclictest2560515-21fschecks_time00:05:172
2457839994133,4cyclictest2459604-21munin-node19:15:001
2457838994120,11cyclictest2499170-21kworker/u8:0+events_unbound21:09:130
245784199402,14cyclictest2470551-21auditctl19:45:013
2457841994013,3cyclictest2565557-21cstates00:20:133
2457841994010,7cyclictest391ktimers/300:35:233
2457840994033,4cyclictest208-21systemd-logind20:57:072
2457838994031,6cyclictest2464964-21unixbench_multi19:25:240
2457840993933,4cyclictest2482480-21apt20:20:012
2457840993933,4cyclictest2482480-21apt20:20:012
2457839993927,8cyclictest2558392-21sendmail00:00:001
2457838993931,4cyclictest0-21swapper/022:35:010
2457838993927,7cyclictest0-21swapper/022:15:220
245784199382,8cyclictest2533458-21head22:45:253
245784199382,11cyclictest2563088-21head00:10:263
245784199382,10cyclictest2560089-21cron00:05:003
245784199382,10cyclictest2560089-21cron00:05:003
2457841993814,3cyclictest2547744-21/usr/sbin/munin23:30:193
2457841993812,6cyclictest0-21swapper/323:05:233
245784199381,12cyclictest2510764-21grep21:40:213
2457840993832,4cyclictest2544094-21sh23:20:002
2457840993830,4cyclictest0-21swapper/223:39:592
2457840993829,6cyclictest2476908-21unixbench_multi20:00:282
2457840993828,6cyclictest0-21swapper/223:48:362
2457839993831,5cyclictest2466002-21kworker/u8:2+events_unbound19:41:521
2457839993828,6cyclictest2506378-21idleruntime-cro21:30:011
2457839993827,7cyclictest2473526-21grep19:50:251
2457839993826,8cyclictest2496122-21munin-run21:00:001
2457839993818,5cyclictest131rcu_preempt21:40:011
245783899388,21cyclictest131rcu_preempt22:35:260
2457838993826,8cyclictest2535106-21grep22:50:250
245784199372,9cyclictest2514663-21sed21:50:253
2457841993726,5cyclictest2538513-21grep23:00:253
2457840993728,5cyclictest0-21swapper/220:44:592
2457840993726,6cyclictest0-21swapper/222:40:252
2457839993730,5cyclictest2470426-21kworker/u8:1+events_unbound19:56:571
2457839993729,4cyclictest0-21swapper/120:35:171
2457839993721,5cyclictest131rcu_preempt21:55:171
2457839993719,5cyclictest131rcu_preempt23:19:591
2457839993717,12cyclictest2480447-21kworker/u8:2+events_unbound20:11:341
2457839993716,13cyclictest131rcu_preempt20:15:211
2457839993716,13cyclictest131rcu_preempt20:15:211
2457838993726,7cyclictest2475661-21sendmail20:00:010
2457841993625,7cyclictest2494000-21grep20:50:283
245784199362,12cyclictest2545805-21cron23:24:593
2457841993612,3cyclictest0-21swapper/323:10:193
2457840993628,4cyclictest0-21swapper/220:45:252
2457840993626,6cyclictest0-21swapper/223:34:592
2457840993621,12cyclictest311ktimers/223:25:152
2457839993630,4cyclictest2549187-21kworker/u8:0+events_unbound23:37:391
2457839993628,4cyclictest0-21swapper/122:10:151
2457839993624,5cyclictest131rcu_preempt21:53:461
2457838993626,6cyclictest2473541-21grep19:50:240
245783899360,9cyclictest11-21ksoftirqd/021:55:110
2457841993526,5cyclictest0-21swapper/322:40:253
2457841993523,7cyclictest0-21swapper/320:00:283
2457841993518,3cyclictest2567892-21mailstats00:25:233
245784099353,3cyclictest131rcu_preempt23:05:122
2457840993525,6cyclictest0-21swapper/223:50:262
2457840993525,6cyclictest0-21swapper/223:50:262
2457840993523,7cyclictest0-21swapper/221:45:252
2457840993522,8cyclictest311ktimers/221:00:132
2457839993527,4cyclictest0-21swapper/122:15:211
2457839993526,7cyclictest2551927-21kworker/u8:1+events_unbound00:12:491
2457839993526,6cyclictest2541957-21grep23:10:251
2457839993525,6cyclictest0-21swapper/122:55:011
2457838993528,5cyclictest2528561-21kworker/u8:1+events_unbound22:47:280
2457838993525,6cyclictest2506493-21grep21:30:000
2457838993523,8cyclictest2509526-21grep21:35:260
2457838993523,8cyclictest151rcuc/019:15:110
2457838993515,7cyclictest11-21ksoftirqd/023:35:000
245783899350,10cyclictest11-21ksoftirqd/020:35:120
2457841993422,8cyclictest2473502-21grep19:50:243
2457841993422,7cyclictest0-21swapper/319:25:233
2457840993425,6cyclictest2471799-21unixbench_multi19:45:262
2457840993424,6cyclictest0-21swapper/222:00:272
2457840993410,5cyclictest131rcu_preempt21:10:132
2457839993419,7cyclictest2457836-21cyclictest00:31:171
2457839993418,6cyclictest2511377-21kworker/u8:1+events_unbound21:45:411
2457839993418,4cyclictest131rcu_preempt19:35:171
2457839993418,4cyclictest131rcu_preempt19:15:141
2457839993417,11cyclictest2551927-21kworker/u8:1-events_freezable_power_00:22:181
2457839993415,4cyclictest131rcu_preempt21:18:541
2457839993415,4cyclictest131rcu_preempt20:00:251
2457838993426,4cyclictest2502971-21sendmail21:20:010
2457838993424,6cyclictest0-21swapper/023:15:260
2457838993424,5cyclictest2500819-21head21:10:260
2457838993419,9cyclictest131rcu_preempt19:12:290
245784199332,28cyclictest2468840-21cut19:40:013
2457841993319,10cyclictest391ktimers/323:25:153
2457840993325,5cyclictest0-21swapper/221:10:012
2457840993325,5cyclictest0-21swapper/219:40:272
2457840993324,6cyclictest0-21swapper/221:20:252
2457840993324,6cyclictest0-21swapper/220:55:012
2457840993324,5cyclictest0-21swapper/221:40:002
2457840993322,5cyclictest2521631-21kworker/u8:0+events_unbound22:15:162
2457840993318,5cyclictest2535459-21kworker/u8:1+events_unbound22:55:252
2457840993315,10cyclictest2487488-21kworker/u8:1+events_unbound20:37:062
2457840993313,6cyclictest131rcu_preempt20:10:132
2457840993310,8cyclictest131rcu_preempt19:35:112
2457839993325,4cyclictest2540685-21cron23:10:011
2457839993325,4cyclictest0-21swapper/121:05:171
2457839993323,6cyclictest231ktimers/122:00:151
2457839993318,5cyclictest53-21kcompactd021:22:551
2457839993318,4cyclictest131rcu_preempt19:32:101
2457839993316,5cyclictest131rcu_preempt23:05:011
2457839993315,4cyclictest131rcu_preempt22:55:211
2457839993313,5cyclictest131rcu_preempt20:10:001
2457838993325,4cyclictest0-21swapper/022:55:260
2457838993323,8cyclictest2551764-21fschecks_count23:40:170
2457838993318,9cyclictest131rcu_preempt21:00:010
2457838993315,8cyclictest131rcu_preempt23:05:220
2457838993310,4cyclictest131rcu_preempt21:30:120
2457841993221,7cyclictest2459026-21grep19:10:253
245784199320,17cyclictest391ktimers/322:35:223
2457840993225,4cyclictest0-21swapper/222:25:012
2457840993224,4cyclictest0-21swapper/223:10:162
2457840993223,6cyclictest0-21swapper/222:40:002
2457840993218,6cyclictest2558018-21kworker/u8:3+events_unbound00:00:192
2457840993218,6cyclictest2558018-21kworker/u8:3+events_unbound00:00:182
2457840993217,5cyclictest2532039-21kworker/u8:0+events_unbound22:51:472
2457840993211,8cyclictest2500889-21kworker/u8:1+events_unbound21:30:142
2457839993226,4cyclictest2565066-21kworker/u8:0+events_unbound00:29:311
2457839993224,4cyclictest0-21swapper/121:40:171
2457839993216,5cyclictest131rcu_preempt00:00:281
2457839993216,5cyclictest131rcu_preempt00:00:271
2457839993215,5cyclictest131rcu_preempt22:20:181
2457839993215,3cyclictest131rcu_preempt20:50:231
2457839993214,6cyclictest131rcu_preempt19:20:251
2457839993214,5cyclictest131rcu_preempt22:40:111
2457838993226,4cyclictest2478742-21kworker/u8:0+events_unbound20:50:420
2457838993225,3cyclictest0-21swapper/022:10:000
2457838993218,3cyclictest131rcu_preempt20:45:000
2457838993215,6cyclictest2441539-21kworker/u8:0+events_unbound19:46:360
2457838993215,11cyclictest131rcu_preempt00:25:220
2457841993110,7cyclictest2480932-21date20:15:013
2457840993123,5cyclictest0-21swapper/222:10:232
2457840993122,6cyclictest0-21swapper/223:40:262
2457840993122,6cyclictest0-21swapper/200:10:272
2457840993119,6cyclictest2457528-21kworker/u8:1+events_unbound19:20:372
2457840993117,7cyclictest131rcu_preempt19:15:202
245784099311,5cyclictest131rcu_preempt22:25:112
2457840993114,6cyclictest2525123-21kworker/u8:2+events_unbound22:34:102
245783999319,7cyclictest24-21ksoftirqd/121:10:261
2457839993121,7cyclictest2508276-21sh21:35:011
2457839993116,5cyclictest2441539-21kworker/u8:0+events_unbound19:28:001
2457839993113,4cyclictest131rcu_preempt22:45:241
2457838993120,7cyclictest2482929-21tune2fs20:20:170
2457838993120,7cyclictest2482929-21tune2fs20:20:170
2457838993112,5cyclictest131rcu_preempt20:50:020
2457841993022,4cyclictest0-21swapper/323:40:263
2457841993021,5cyclictest0-21swapper/321:45:253
2457840993022,4cyclictest0-21swapper/220:25:172
2457840993022,4cyclictest0-21swapper/219:10:252
2457840993021,6cyclictest0-21swapper/223:55:252
2457840993021,5cyclictest0-21swapper/221:50:262
2457840993017,6cyclictest2551927-21kworker/u8:1+events_unbound00:25:402
2457840993010,10cyclictest2457836-21cyclictest00:35:122
245783999309,11cyclictest24-21ksoftirqd/119:50:011
245783999308,3cyclictest131rcu_preempt22:30:211
245783999305,13cyclictest24-21ksoftirqd/123:35:011
245783999301,14cyclictest0-21swapper/120:20:261
245783999301,14cyclictest0-21swapper/120:20:261
245783899309,14cyclictest2516783-21kworker/u8:2-events_freezable_power_22:02:390
245783899307,12cyclictest131rcu_preempt22:40:250
245783899305,4cyclictest131rcu_preempt19:40:130
2457838993024,3cyclictest0-21swapper/020:00:150
2457838993021,6cyclictest2487187-21grep20:30:260
2457838993021,6cyclictest0-21swapper/000:20:000
2457838993020,7cyclictest151rcuc/021:50:130
2457838993011,13cyclictest0-21swapper/023:45:250
2457838993010,10cyclictest131rcu_preempt21:40:260
2457841992917,9cyclictest391ktimers/321:05:123
245783999298,9cyclictest0-21swapper/123:53:341
245783999298,9cyclictest0-21swapper/123:53:341
245783999297,6cyclictest24-21ksoftirqd/120:40:231
245783999297,12cyclictest24-21ksoftirqd/100:15:151
245783999295,5cyclictest131rcu_preempt20:30:191
2457839992915,4cyclictest131rcu_preempt23:27:011
2457839992913,5cyclictest131rcu_preempt22:35:241
2457839992913,3cyclictest131rcu_preempt20:45:251
2457839992912,4cyclictest131rcu_preempt21:00:171
245783899299,5cyclictest131rcu_preempt23:20:100
245783899299,11cyclictest11-21ksoftirqd/000:30:150
245783899298,9cyclictest131rcu_preempt19:23:420
245783899293,13cyclictest11-21ksoftirqd/022:20:240
2457838992923,4cyclictest2551927-21kworker/u8:1+events_unbound23:58:370
2457838992919,6cyclictest2504232-21grep21:20:250
2457838992918,6cyclictest0-21swapper/023:25:170
2457838992918,5cyclictest2551927-21kworker/u8:1+events_unbound00:13:110
2457838992913,10cyclictest131rcu_preempt21:50:000
2457841992819,6cyclictest0-21swapper/321:25:013
2457840992819,5cyclictest0-21swapper/221:55:252
2457840992817,5cyclictest2551927-21kworker/u8:1+events_unbound00:34:392
2457840992817,4cyclictest131rcu_preempt20:10:012
2457840992816,6cyclictest2502843-21kworker/u8:3+events_unbound21:20:002
2457840992812,5cyclictest2441539-21kworker/u8:0+events_unbound19:34:162
245783999288,13cyclictest24-21ksoftirqd/123:40:201
245783999287,12cyclictest24-21ksoftirqd/100:05:191
2457839992814,4cyclictest131rcu_preempt22:27:271
2457838992824,2cyclictest13550irq/42-30be0000.ethernet23:50:110
2457838992824,2cyclictest13550irq/42-30be0000.ethernet23:50:110
2457838992821,3cyclictest0-21swapper/020:05:190
2457838992814,8cyclictest131rcu_preempt22:25:100
2457841992721,3cyclictest2496118-21kthreadd21:00:013
2457841992718,6cyclictest2535963-21grep22:55:163
2457841992717,7cyclictest2507853-21grep21:30:253
2457841992717,7cyclictest2502428-21sort21:15:263
2457841992717,6cyclictest0-21swapper/322:20:013
2457840992720,4cyclictest0-21swapper/200:15:252
2457840992719,5cyclictest0-21swapper/220:20:252
2457840992719,5cyclictest0-21swapper/220:20:252
245784099271,23cyclictest204-21dbus-daemon22:07:182
2457840992711,9cyclictest131rcu_preempt21:45:002
2457840992711,10cyclictest131rcu_preempt21:25:172
245783999275,13cyclictest24-21ksoftirqd/123:45:171
245783899278,10cyclictest131rcu_preempt00:35:170
245783899273,13cyclictest0-21swapper/020:10:230
2457838992720,4cyclictest0-21swapper/023:10:250
2457838992720,3cyclictest0-21swapper/019:40:010
245783899271,14cyclictest0-21swapper/023:35:470
2457841992619,4cyclictest0-21swapper/300:05:263
2457841992619,3cyclictest0-21swapper/321:55:193
2457841992616,7cyclictest2490589-21grep20:40:243
2457840992619,5cyclictest2485727-21kworker/u8:2+events_unbound20:31:052
245783899265,11cyclictest11-21ksoftirqd/023:00:250
2457838992619,5cyclictest2480447-21kworker/u8:2+events_unbound20:16:420
2457838992619,5cyclictest2480447-21kworker/u8:2+events_unbound20:16:410
245783899260,17cyclictest131rcu_preempt21:00:220
2457841992517,4cyclictest2488876-21head20:35:253
2457841992515,6cyclictest2496527-21fschecks_count21:00:153
2457840992519,4cyclictest2533753-21kworker/u8:2+events_unbound23:00:192
2457840992518,5cyclictest2472159-21kworker/u8:2+events_unbound19:53:422
2457840992510,8cyclictest131rcu_preempt23:20:212
2457838992513,4cyclictest131rcu_preempt00:05:150
2457838992512,3cyclictest131rcu_preempt00:00:200
2457838992512,3cyclictest131rcu_preempt00:00:200
2457838992511,7cyclictest131rcu_preempt00:20:110
2457841992418,3cyclictest0-21swapper/323:15:213
245784099246,12cyclictest32-21ksoftirqd/222:45:192
2457840992417,5cyclictest2565066-21kworker/u8:0+events_unbound00:20:142
2457841992317,3cyclictest0-21swapper/322:05:133
2457841992317,3cyclictest0-21swapper/300:16:593
2457841992314,5cyclictest0-21swapper/319:20:013
2457841992312,8cyclictest2557471-21ntp_states23:55:223
2457841992312,8cyclictest2463051-21grep19:20:253
245784199226,10cyclictest2492256-21tail20:45:263
245784199223,12cyclictest2485435-21tail20:25:263
2457841992214,4cyclictest0-21swapper/322:55:003
2457841992210,9cyclictest204-21dbus-daemon20:22:013
2457841992210,9cyclictest204-21dbus-daemon20:22:013
2457841992013,4cyclictest391ktimers/320:30:203
2457841992012,5cyclictest0-21swapper/323:50:133
2457841992012,5cyclictest0-21swapper/323:50:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional