You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 14:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Thu Dec 11, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3744534994939,6cyclictest299-21systemd-logind20:36:181
3744534994939,6cyclictest299-21systemd-logind20:36:171
3744540994841,5cyclictest3762269-21kworker/u8:0+events_unbound20:31:172
3744543994538,5cyclictest3770942-21kworker/u8:1+events_unbound20:21:143
3744543994535,7cyclictest391ktimers/322:30:123
3744540994535,6cyclictest3830929-21grep23:15:262
374453499442,17cyclictest24-21ksoftirqd/122:15:121
374453499442,17cyclictest24-21ksoftirqd/122:15:121
3744529994436,4cyclictest3822826-21apt-key22:55:010
3744529994334,6cyclictest3820485-21unixbench_multi22:45:270
3744529994329,10cyclictest121ktimers/023:45:120
3744534994235,4cyclictest3803661-21cron22:00:001
3744529994234,5cyclictest3803384-21kworker/u8:1+events_unbound22:00:130
3744540994121,7cyclictest131rcu_preempt19:30:132
3744540994121,7cyclictest131rcu_preempt19:30:132
3744543993928,6cyclictest0-21swapper/300:18:533
3744540993929,5cyclictest0-21swapper/219:20:172
3744540993923,12cyclictest311ktimers/221:35:142
3744534993931,6cyclictest3727324-21kworker/u8:0+events_unbound19:16:061
3744534993928,7cyclictest3843319-21cron23:55:001
3744543993832,4cyclictest3810416-21kworker/u8:1+events_unbound22:51:473
3744534993830,5cyclictest3769562-21cron20:20:011
3744534993823,5cyclictest131rcu_preempt00:20:551
3744543993728,5cyclictest0-21swapper/322:25:263
3744540993728,5cyclictest0-21swapper/219:35:162
374453499371,16cyclictest24-21ksoftirqd/122:45:121
3744529993730,3cyclictest0-21swapper/000:20:000
3744529993725,8cyclictest0-21swapper/000:30:260
3744543993629,5cyclictest3787946-21kworker/u8:3+events_unbound21:11:253
3744543993627,7cyclictest3750033-21kworker/u8:2+events_unbound19:36:103
3744543993626,6cyclictest0-21swapper/323:41:543
3744543993622,6cyclictest3855086-21kworker/u8:2+events_unbound00:31:423
3744540993628,4cyclictest0-21swapper/222:45:012
3744540993627,6cyclictest3834375-21unixbench_singl23:25:262
3744540993625,7cyclictest0-21swapper/223:40:262
3744540993625,7cyclictest0-21swapper/222:40:012
3744540993617,6cyclictest131rcu_preempt20:20:252
3744534993629,4cyclictest0-21swapper/122:55:001
3744534993620,6cyclictest3810416-21kworker/u8:1+events_unbound22:31:471
3744529993622,10cyclictest121ktimers/021:45:100
3744543993528,4cyclictest3759127-21idleruntime-cro19:50:013
3744543993528,4cyclictest3759127-21idleruntime-cro19:50:013
3744543993526,5cyclictest3779798-21kthreadd20:50:003
3744543993522,7cyclictest131rcu_preempt21:15:213
3744540993526,6cyclictest3791288-21unixbench_multi21:20:272
3744540993526,5cyclictest0-21swapper/222:35:012
3744540993526,4cyclictest0-21swapper/220:35:172
3744540993526,4cyclictest0-21swapper/220:35:172
3744540993523,7cyclictest0-21swapper/219:15:252
3744534993519,5cyclictest131rcu_preempt21:15:121
3744529993528,4cyclictest3796856-21cron21:40:010
3744543993426,4cyclictest0-21swapper/323:10:003
3744543993425,5cyclictest0-21swapper/320:44:593
374454399342,11cyclictest40-21ksoftirqd/322:20:133
3744543993419,9cyclictest131rcu_preempt21:09:223
3744540993424,6cyclictest0-21swapper/220:10:262
374453499349,15cyclictest24-21ksoftirqd/120:50:011
3744534993426,4cyclictest0-21swapper/123:55:251
3744534993424,7cyclictest3841632-21idleruntime-cro23:49:591
3744534993423,7cyclictest3782780-21grep20:55:291
3744534993423,6cyclictest0-21swapper/121:10:161
3744534993416,4cyclictest0-21swapper/100:39:141
3744529993425,5cyclictest0-21swapper/020:15:010
3744529993424,6cyclictest0-21swapper/023:55:250
3744529993424,6cyclictest0-21swapper/022:30:250
3744529993423,6cyclictest0-21swapper/021:05:000
3744529993423,6cyclictest0-21swapper/019:40:280
3744529993411,12cyclictest131rcu_preempt23:30:100
3744543993326,4cyclictest0-21swapper/320:40:003
3744543993326,4cyclictest0-21swapper/320:40:003
3744543993324,6cyclictest3762529-21ls19:59:593
3744543993324,6cyclictest0-21swapper/323:30:003
3744543993322,4cyclictest131rcu_preempt23:15:183
3744543993321,5cyclictest3836344-21kworker/u8:1+events_unbound23:33:533
3744543993318,6cyclictest3843285-21kworker/u8:0+events_unbound23:59:423
3744540993327,4cyclictest3786340-21kworker/u8:2+events_unbound21:26:302
3744540993324,6cyclictest3777677-21unixbench_singl20:40:252
3744540993323,7cyclictest440-21cron20:05:002
3744540993323,6cyclictest0-21swapper/222:00:272
3744540993322,7cyclictest0-21swapper/200:35:272
374453499338,7cyclictest24-21ksoftirqd/120:25:011
3744534993325,5cyclictest3755280-21head19:35:251
3744534993325,4cyclictest0-21swapper/122:35:171
3744534993325,4cyclictest0-21swapper/119:10:271
3744534993322,8cyclictest440-21cron22:30:001
3744534993315,6cyclictest3782163-21kworker/u8:0+events_unbound21:04:301
3744529993326,5cyclictest3762269-21kworker/u8:0+events_unbound20:06:140
3744529993323,7cyclictest440-21cron21:30:000
3744529993322,6cyclictest0-21swapper/020:40:250
3744529993315,15cyclictest3772992-21idleruntime-cro20:30:010
3744543993225,4cyclictest0-21swapper/321:50:283
3744543993224,4cyclictest0-21swapper/323:00:263
3744543993224,4cyclictest0-21swapper/300:00:263
3744543993221,7cyclictest3769553-21apt20:20:013
3744543993221,5cyclictest3839807-21kworker/u8:1+events_unbound23:45:013
3744543993219,5cyclictest3742306-21kworker/u8:1+events_unbound19:17:303
3744540993222,6cyclictest0-21swapper/222:15:002
3744540993222,6cyclictest0-21swapper/222:15:002
374453499329,14cyclictest24-21ksoftirqd/120:15:021
3744534993225,3cyclictest0-21swapper/120:00:001
3744534993224,4cyclictest0-21swapper/123:35:251
3744534993224,4cyclictest0-21swapper/123:35:251
3744534993224,4cyclictest0-21swapper/120:00:191
3744534993219,6cyclictest131rcu_preempt21:20:191
3744534993214,6cyclictest131rcu_preempt21:55:001
374452999323,5cyclictest131rcu_preempt20:45:130
3744529993225,4cyclictest0-21swapper/023:20:000
3744529993222,6cyclictest0-21swapper/022:15:150
3744529993222,6cyclictest0-21swapper/022:15:140
374454399319,15cyclictest0-21swapper/321:00:263
3744543993124,5cyclictest3793416-21kworker/u8:1+events_unbound21:43:233
3744543993124,5cyclictest3742306-21kworker/u8:1+events_unbound19:24:283
3744543993124,4cyclictest0-21swapper/322:20:003
3744543993124,4cyclictest0-21swapper/322:19:593
3744543993124,4cyclictest0-21swapper/319:30:013
3744543993123,6cyclictest3762269-21kworker/u8:0+events_unbound20:11:153
3744543993123,4cyclictest0-21swapper/320:30:263
3744543993122,5cyclictest0-21swapper/321:20:273
3744543993121,6cyclictest0-21swapper/300:20:263
3744543993120,8cyclictest391ktimers/322:55:133
3744543993117,6cyclictest3803595-21kworker/u8:3+events_unbound22:07:473
3744540993124,4cyclictest3789595-21unixbench_singl21:15:252
3744540993123,5cyclictest3808511-21kworker/u8:2+events_unbound22:15:332
3744540993123,5cyclictest3808511-21kworker/u8:2+events_unbound22:15:332
3744540993123,4cyclictest0-21swapper/200:10:162
3744540993121,6cyclictest0-21swapper/222:06:382
3744540993121,6cyclictest0-21swapper/220:55:302
3744540993121,6cyclictest0-21swapper/220:20:012
3744540993121,6cyclictest0-21swapper/200:05:282
3744540993120,7cyclictest3787915-21grep21:10:242
3744540993120,6cyclictest0-21swapper/223:30:252
3744534993121,7cyclictest3752339-21latency_hist19:30:001
3744534993119,8cyclictest231ktimers/121:35:011
3744534993116,5cyclictest3786101-21timerwakeupswit21:05:251
3744534993115,3cyclictest131rcu_preempt21:25:201
3744534993114,6cyclictest131rcu_preempt20:50:271
3744529993125,4cyclictest3750033-21kworker/u8:2+events_unbound19:28:210
3744529993124,4cyclictest3787339-21runrttasks21:10:200
3744529993122,5cyclictest0-21swapper/020:05:010
3744529993121,6cyclictest0-21swapper/020:20:000
3744529993120,7cyclictest0-21swapper/000:10:260
3744529993119,7cyclictest0-21swapper/019:15:250
3744529993115,7cyclictest3803206-21grep21:55:250
374454399304,3cyclictest131rcu_preempt00:25:133
3744543993023,5cyclictest3776210-21kworker/u8:2+events_unbound20:59:423
3744543993022,6cyclictest3727324-21kworker/u8:0+events_unbound19:10:033
3744543993021,6cyclictest3750033-21kworker/u8:2+events_unbound19:41:513
3744540993022,5cyclictest0-21swapper/200:00:012
3744540993020,6cyclictest0-21swapper/223:55:002
3744540993020,6cyclictest0-21swapper/222:45:152
3744540993019,6cyclictest0-21swapper/223:00:012
374453499307,3cyclictest131rcu_preempt00:25:261
3744534993024,4cyclictest3757036-21kworker/u8:0+events_unbound19:47:431
3744534993024,4cyclictest3757036-21kworker/u8:0+events_unbound19:47:431
3744534993023,5cyclictest3827767-21kworker/u8:2+events_unbound23:13:431
3744534993022,5cyclictest0-21swapper/121:35:271
3744534993022,4cyclictest0-21swapper/100:15:171
3744534993021,4cyclictest0-21swapper/122:10:171
3744534993021,4cyclictest0-21swapper/122:10:171
3744534993015,3cyclictest131rcu_preempt23:41:501
3744534993012,6cyclictest3805367-21kworker/u8:0+events_unbound22:24:161
3744534993012,3cyclictest0-21swapper/121:44:561
3744529993022,3cyclictest0-21swapper/019:40:000
3744529993019,6cyclictest0-21swapper/000:05:290
374454399299,11cyclictest40-21ksoftirqd/320:00:233
3744543992922,4cyclictest0-21swapper/320:25:193
3744543992919,6cyclictest3803215-21grep21:55:253
3744543992912,9cyclictest0-21swapper/321:45:213
3744540992922,4cyclictest0-21swapper/219:30:012
3744540992920,4cyclictest0-21swapper/223:45:152
3744540992918,7cyclictest0-21swapper/221:55:002
3744540992918,7cyclictest0-21swapper/219:45:202
3744540992918,7cyclictest0-21swapper/219:45:202
374453499298,6cyclictest131rcu_preempt22:55:161
374453499297,13cyclictest131rcu_preempt19:25:011
374453499297,11cyclictest24-21ksoftirqd/123:35:011
3744534992921,6cyclictest3750033-21kworker/u8:2+events_unbound19:40:591
3744534992914,3cyclictest131rcu_preempt00:00:251
3744529992923,3cyclictest0-21swapper/023:40:000
3744529992923,3cyclictest0-21swapper/023:40:000
3744529992921,5cyclictest0-21swapper/021:20:010
3744529992919,6cyclictest0-21swapper/022:40:240
3744529992919,6cyclictest0-21swapper/022:20:250
3744529992917,6cyclictest0-21swapper/021:45:000
3744529992916,5cyclictest637-21runrttasks19:10:150
374454399288,13cyclictest40-21ksoftirqd/321:37:043
374454399281,6cyclictest0-21swapper/323:10:133
3744543992813,9cyclictest131rcu_preempt22:10:143
3744543992813,9cyclictest131rcu_preempt22:10:143
3744543992812,4cyclictest131rcu_preempt20:07:293
3744543992812,10cyclictest131rcu_preempt21:25:243
3744540992821,5cyclictest3762057-21unixbench_multi19:55:262
3744540992820,4cyclictest0-21swapper/220:05:262
3744540992818,6cyclictest0-21swapper/221:10:012
3744540992818,5cyclictest0-21swapper/221:30:282
374453499289,5cyclictest221rcuc/121:47:181
3744534992821,4cyclictest0-21swapper/123:05:271
3744534992819,7cyclictest3805367-21kworker/u8:0+events_unbound22:04:581
374453499281,7cyclictest0-21swapper/123:20:121
3744534992814,3cyclictest131rcu_preempt20:25:221
3744534992810,5cyclictest131rcu_preempt20:35:011
374452999288,3cyclictest38540692idleruntime00:25:170
3744529992817,6cyclictest0-21swapper/021:50:270
374454399273,5cyclictest131rcu_preempt00:40:013
3744543992722,3cyclictest3839807-21kworker/u8:1-events_freezable_power_00:05:153
3744543992721,3cyclictest0-21swapper/321:30:173
3744543992716,3cyclictest131rcu_preempt19:35:013
3744543992716,3cyclictest131rcu_preempt19:35:003
374454399271,5cyclictest38162172grep22:35:153
374454099278,3cyclictest131rcu_preempt23:14:592
3744540992721,4cyclictest3805367-21kworker/u8:0+events_unbound22:22:112
3744540992720,4cyclictest3760050-21mailstats19:50:222
3744540992718,5cyclictest0-21swapper/223:20:282
374453499278,5cyclictest131rcu_preempt20:05:241
374453499277,5cyclictest131rcu_preempt19:50:171
3744534992716,4cyclictest3727324-21kworker/u8:0+events_unbound19:30:181
3744534992716,4cyclictest3727324-21kworker/u8:0+events_unbound19:30:181
374453499271,5cyclictest3856527-21unixbench_multi00:30:251
3744534992713,3cyclictest131rcu_preempt23:00:201
3744534992711,7cyclictest24-21ksoftirqd/122:05:261
3744534992711,3cyclictest131rcu_preempt20:40:161
3744529992721,4cyclictest3817350-21kworker/u8:2+events_unbound23:01:470
3744529992721,4cyclictest3757036-21kworker/u8:0+events_unbound19:46:110
3744529992721,4cyclictest3757036-21kworker/u8:0+events_unbound19:46:110
3744529992720,3cyclictest0-21swapper/022:40:000
3744529992719,5cyclictest11-21ksoftirqd/023:25:120
3744529992719,5cyclictest11-21ksoftirqd/019:20:140
3744529992719,4cyclictest0-21swapper/020:35:010
3744529992718,5cyclictest0-21swapper/020:50:270
374454399269,5cyclictest131rcu_preempt19:55:003
374454399268,5cyclictest131rcu_preempt00:10:163
374454399266,13cyclictest40-21ksoftirqd/322:47:213
3744543992619,5cyclictest3776210-21kworker/u8:2+events_unbound20:50:023
374454399260,15cyclictest0-21swapper/323:35:113
374454399260,15cyclictest0-21swapper/323:35:103
374453499261,14cyclictest3848449-21cron00:10:011
3744534992610,3cyclictest131rcu_preempt23:25:181
3744529992617,6cyclictest0-21swapper/022:25:170
374454399255,11cyclictest40-21ksoftirqd/322:00:183
374454399251,8cyclictest40-21ksoftirqd/322:40:233
3744540992519,4cyclictest3856822-21kworker/u8:0+events_unbound00:34:392
3744540992519,3cyclictest0-21swapper/221:05:012
3744540992518,5cyclictest3827767-21kworker/u8:2+events_unbound23:09:592
3744540992517,4cyclictest0-21swapper/220:50:272
3744540992517,4cyclictest0-21swapper/220:45:252
3744540992515,6cyclictest0-21swapper/222:50:282
374453499251,13cyclictest0-21swapper/122:40:201
3744529992515,7cyclictest3842762-21timerandwakeup23:50:260
374452999251,3cyclictest3845849-21seq00:00:210
3744540992418,4cyclictest3812374-21kworker/u8:2+events_unbound22:26:082
3744540992417,3cyclictest0-21swapper/223:36:542
3744540992417,3cyclictest0-21swapper/223:36:532
3744540992417,3cyclictest0-21swapper/200:00:242
3744540992415,6cyclictest3746550-21sed19:15:022
3744540992415,6cyclictest0-21swapper/220:25:272
3744540992414,7cyclictest32-21ksoftirqd/200:15:262
3744540992412,6cyclictest0-21swapper/200:25:262
374454099241,12cyclictest0-21swapper/223:04:232
3744529992417,3cyclictest0-21swapper/021:10:010
3744529992414,6cyclictest0-21swapper/019:30:270
3744529992414,6cyclictest0-21swapper/019:30:260
374452999241,20cyclictest630-21snmpd00:21:060
374452999241,19cyclictest3775948-21grep20:35:260
374452999241,19cyclictest3775948-21grep20:35:250
374452999241,19cyclictest0-21swapper/023:07:540
374452999241,19cyclictest0-21swapper/022:09:440
374452999241,19cyclictest0-21swapper/000:38:050
3744540992318,3cyclictest3853703-21latency_hist00:25:012
3744540992315,4cyclictest0-21swapper/219:44:592
3744540992313,7cyclictest32-21ksoftirqd/221:45:182
3744540992313,6cyclictest0-21swapper/221:40:262
3744540992310,10cyclictest32-21ksoftirqd/221:55:212
3744529992317,3cyclictest0-21swapper/023:10:240
3744529992316,3cyclictest0-21swapper/022:10:320
3744529992316,3cyclictest0-21swapper/022:10:320
3744529992316,3cyclictest0-21swapper/021:21:550
3744529992316,3cyclictest0-21swapper/019:50:060
3744529992315,4cyclictest0-21swapper/023:40:180
374452999231,3cyclictest0-21swapper/023:20:160
374452999231,18cyclictest0-21swapper/022:56:040
374452999230,19cyclictest0-21swapper/021:34:050
3744529992217,3cyclictest13650irq/42-30be0000.ethernet20:20:140
374452999221,19cyclictest0-21swapper/019:55:160
374452999221,18cyclictest3783164-21taskset20:59:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional