You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 09:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Dec 06, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2981120995242,7cyclictest3071219-21unixbench_singl23:25:283
2981112995040,8cyclictest3059646-21kworker/u8:2+events_unbound23:12:051
2981115994839,6cyclictest3038781-21cron21:55:002
2981115994839,6cyclictest3038781-21cron21:55:002
2981115994738,5cyclictest3061374-21cron23:00:012
2981112994436,4cyclictest0-21swapper/120:20:011
2981107994437,5cyclictest3017755-21kworker/u8:1+events_unbound20:56:400
2981107994418,7cyclictest131rcu_preempt20:05:110
2981115994336,4cyclictest2998701-21munin-run20:00:002
2981115994334,6cyclictest3004399-21fschecks_count20:15:172
2981112994332,7cyclictest3040499-21cut22:00:001
2981107994235,5cyclictest3054425-21kworker/u8:0+events_unbound22:52:010
2981120994128,9cyclictest440-21cron20:30:013
2981107994134,5cyclictest3059646-21kworker/u8:2+events_unbound22:55:420
2981112994023,5cyclictest131rcu_preempt19:50:171
2981115993930,6cyclictest3026356-21unixbench_multi21:15:272
2981112993931,4cyclictest0-21swapper/123:00:151
2981112993928,7cyclictest0-21swapper/121:20:001
2981112993920,5cyclictest131rcu_preempt23:30:211
2981107993932,4cyclictest2995410-21latency_hist19:50:010
2981107993926,9cyclictest3012140-21grep20:35:260
298111599382,4cyclictest0-21swapper/223:40:122
2981112993829,7cyclictest3040122-21kworker/u8:0+events_unbound22:26:581
2981112993825,9cyclictest2986364-21grep19:20:261
2981112993820,5cyclictest131rcu_preempt22:40:281
2981112993818,4cyclictest131rcu_preempt20:05:151
2981112993816,5cyclictest131rcu_preempt21:30:401
2981107993830,4cyclictest0-21swapper/020:20:000
298110799381,26cyclictest11-21ksoftirqd/020:00:020
2981120993729,4cyclictest0-21swapper/300:30:003
2981115993728,5cyclictest0-21swapper/223:35:162
2981115993728,4cyclictest0-21swapper/222:50:172
2981112993731,4cyclictest3043603-21kworker/u8:1+events_unbound22:06:551
2981112993731,4cyclictest3030014-21kworker/u8:1+events_unbound21:51:531
2981112993731,4cyclictest3030014-21kworker/u8:1+events_unbound21:51:521
2981112993730,4cyclictest3019816-21sendmail21:00:011
2981112993729,6cyclictest3011088-21kworker/u8:2+events_unbound20:36:351
2981112993716,9cyclictest131rcu_preempt20:32:411
2981107993728,4cyclictest0-21swapper/019:20:000
2981107993728,4cyclictest0-21swapper/019:20:000
2981120993629,4cyclictest3037482-21fschecks_count21:50:163
2981120993629,4cyclictest3037482-21fschecks_count21:50:153
2981120993627,6cyclictest215-21dbus-daemon20:16:293
2981120993623,9cyclictest0-21swapper/319:15:013
2981115993619,11cyclictest3045568-21kworker/u8:2+events_unbound22:33:152
2981115993619,11cyclictest3045568-21kworker/u8:2+events_unbound22:33:152
2981112993630,4cyclictest3074997-21kworker/u8:0+events_unbound23:42:091
2981112993619,5cyclictest131rcu_preempt19:40:011
2981112993617,5cyclictest131rcu_preempt22:12:001
2981107993629,4cyclictest3016194-21idleruntime-cro20:50:000
2981120993527,5cyclictest3069932-21idleruntime-cro23:25:013
2981120993527,4cyclictest0-21swapper/323:50:143
2981120993527,4cyclictest0-21swapper/300:05:343
2981120993526,6cyclictest0-21swapper/323:59:593
2981115993528,4cyclictest3000200-21unixbench_singl20:00:262
2981115993527,5cyclictest0-21swapper/223:50:242
2981115993527,4cyclictest0-21swapper/223:30:012
2981115993527,4cyclictest0-21swapper/222:47:002
2981115993525,6cyclictest0-21swapper/200:04:592
2981115993517,11cyclictest3082086-21kworker/u8:1+events_unbound00:05:212
2981112993529,4cyclictest2990059-21kworker/u8:1+events_unbound19:56:271
2981112993523,7cyclictest0-21swapper/100:25:291
2981112993521,4cyclictest131rcu_preempt21:05:411
2981112993518,5cyclictest131rcu_preempt00:10:151
2981112993516,4cyclictest131rcu_preempt21:35:241
2981112993515,4cyclictest131rcu_preempt22:19:421
2981107993526,7cyclictest121ktimers/000:25:150
298110799351,12cyclictest11-21ksoftirqd/022:05:120
2981120993424,6cyclictest0-21swapper/320:40:013
2981120993424,6cyclictest0-21swapper/319:50:253
2981120993424,6cyclictest0-21swapper/300:35:013
2981115993425,5cyclictest0-21swapper/222:05:002
2981115993424,7cyclictest0-21swapper/220:55:002
2981115993424,6cyclictest0-21swapper/221:45:252
2981112993427,5cyclictest3017755-21kworker/u8:1+events_unbound21:01:411
2981112993427,5cyclictest2986620-21kworker/u8:2+events_unbound19:25:431
2981112993419,4cyclictest131rcu_preempt00:01:531
2981112993419,3cyclictest131rcu_preempt23:00:011
2981112993417,5cyclictest131rcu_preempt20:05:001
2981112993417,4cyclictest131rcu_preempt00:08:441
2981112993414,5cyclictest131rcu_preempt00:25:011
2981112993412,10cyclictest131rcu_preempt21:47:441
298110799343,20cyclictest11-21ksoftirqd/019:30:130
2981107993427,5cyclictest3084914-21kworker/u8:3+events_unbound00:08:470
2981107993424,5cyclictest3000205-21unixbench_singl20:00:270
2981115993327,4cyclictest3040122-21kworker/u8:0+events_unbound22:11:552
2981115993316,5cyclictest3088939-21kworker/u8:0+events_unbound00:20:432
2981112993325,5cyclictest3064793-21cron23:10:011
2981112993320,4cyclictest131rcu_preempt00:39:531
2981112993319,6cyclictest2988338-21kworker/u8:0+events_unbound19:43:261
2981112993318,4cyclictest131rcu_preempt23:29:351
2981112993317,9cyclictest131rcu_preempt19:30:191
2981112993317,5cyclictest131rcu_preempt19:20:001
2981112993317,5cyclictest131rcu_preempt19:20:001
2981112993316,5cyclictest131rcu_preempt22:20:211
2981112993313,5cyclictest131rcu_preempt20:10:171
2981107993325,4cyclictest0-21swapper/019:50:250
2981107993325,3cyclictest0-21swapper/019:40:260
2981107993319,8cyclictest131rcu_preempt22:00:250
2981107993316,10cyclictest131rcu_preempt21:55:140
2981115993224,4cyclictest0-21swapper/221:06:402
2981115993222,6cyclictest0-21swapper/219:35:172
2981115993221,7cyclictest0-21swapper/219:45:262
2981115993219,10cyclictest0-21swapper/222:35:252
2981115993218,4cyclictest3007404-21kworker/u8:0+events_unbound20:27:442
2981112993224,6cyclictest231ktimers/121:40:101
2981112993222,6cyclictest3007000-21grep20:20:261
2981112993220,8cyclictest231ktimers/122:00:161
2981112993219,5cyclictest3017755-21kworker/u8:1+events_unbound20:54:481
2981112993216,5cyclictest131rcu_preempt22:35:171
2981112993216,5cyclictest131rcu_preempt20:40:261
2981112993216,3cyclictest131rcu_preempt23:54:481
2981112993214,3cyclictest131rcu_preempt22:35:001
2981112993214,3cyclictest131rcu_preempt22:35:001
2981112993213,12cyclictest0-21swapper/123:22:261
298110799325,5cyclictest131rcu_preempt22:25:150
2981107993225,3cyclictest0-21swapper/021:00:270
298110799321,8cyclictest11-21ksoftirqd/020:50:130
2981107993216,8cyclictest131rcu_preempt22:25:020
2981107993216,3cyclictest131rcu_preempt19:40:020
2981107993212,7cyclictest11-21ksoftirqd/020:11:290
2981120993125,3cyclictest0-21swapper/319:30:173
2981120993124,4cyclictest0-21swapper/322:09:593
2981120993121,6cyclictest0-21swapper/320:45:003
2981115993125,4cyclictest3082086-21kworker/u8:1+events_unbound00:29:072
2981115993121,6cyclictest0-21swapper/223:15:002
298111299318,13cyclictest24-21ksoftirqd/122:45:171
2981112993117,3cyclictest131rcu_preempt23:45:171
2981112993117,3cyclictest131rcu_preempt23:45:171
2981112993116,4cyclictest131rcu_preempt21:25:191
2981112993116,3cyclictest131rcu_preempt19:10:251
2981112993115,5cyclictest131rcu_preempt21:10:251
2981112993114,5cyclictest131rcu_preempt19:45:131
298110799318,12cyclictest11-21ksoftirqd/021:20:230
298110799317,7cyclictest11-21ksoftirqd/023:40:250
2981107993120,8cyclictest440-21cron23:30:000
2981107993118,7cyclictest3064808-21munin-run23:10:000
2981107993115,8cyclictest131rcu_preempt19:25:560
298110799310,27cyclictest0-21swapper/000:00:140
2981120993021,5cyclictest0-21swapper/321:55:253
2981120993019,4cyclictest131rcu_preempt23:00:013
2981115993024,4cyclictest3023247-21kworker/u8:2+events_unbound21:10:432
2981115993024,3cyclictest0-21swapper/200:10:162
2981115993022,4cyclictest0-21swapper/219:30:252
2981115993021,6cyclictest3064398-21unixbench_singl23:05:252
2981115993020,6cyclictest0-21swapper/221:20:162
2981115993016,5cyclictest3011088-21kworker/u8:2+events_unbound20:43:482
2981115993016,5cyclictest2990059-21kworker/u8:1+events_unbound19:50:052
2981115993011,11cyclictest32-21ksoftirqd/222:15:242
2981112993017,4cyclictest131rcu_preempt00:31:501
2981112993014,5cyclictest131rcu_preempt23:55:211
2981112993011,6cyclictest131rcu_preempt00:15:211
298110799309,13cyclictest11-21ksoftirqd/021:10:230
298110799308,5cyclictest131rcu_preempt22:15:160
2981107993024,4cyclictest3059646-21kworker/u8:2+events_unbound23:17:080
2981107993023,5cyclictest2986620-21kworker/u8:2+events_unbound19:23:430
2981107993022,6cyclictest3024984-21kworker/u8:1+events_unbound21:15:140
2981107993021,6cyclictest3052252-21timerandwakeup22:30:250
2981107993021,6cyclictest3052252-21timerandwakeup22:30:250
2981107993021,4cyclictest0-21swapper/021:05:270
2981107993015,8cyclictest131rcu_preempt00:33:270
2981107993014,10cyclictest131rcu_preempt22:40:190
298110799300,7cyclictest0-21swapper/021:25:160
298110799300,10cyclictest11-21ksoftirqd/020:40:140
2981120992923,3cyclictest3088687-21kthreadd00:20:003
2981120992922,4cyclictest0-21swapper/323:35:253
2981120992921,5cyclictest0-21swapper/319:15:263
2981120992921,5cyclictest0-21swapper/319:15:253
2981120992921,4cyclictest0-21swapper/322:30:263
2981120992921,4cyclictest0-21swapper/322:30:253
2981120992920,5cyclictest0-21swapper/322:20:293
2981120992919,6cyclictest0-21swapper/323:05:253
2981120992917,6cyclictest3047501-21kworker/u8:1+events_unbound22:49:263
2981120992917,6cyclictest3023247-21kworker/u8:2+events_unbound21:14:303
2981120992916,9cyclictest0-21swapper/320:55:173
2981120992916,9cyclictest0-21swapper/320:30:193
2981115992920,6cyclictest0-21swapper/223:20:192
2981115992918,7cyclictest0-21swapper/223:45:272
2981115992918,7cyclictest0-21swapper/223:45:272
2981115992918,7cyclictest0-21swapper/222:05:262
2981115992916,7cyclictest32-21ksoftirqd/220:25:012
2981115992914,9cyclictest32-21ksoftirqd/220:10:282
2981115992914,8cyclictest32-21ksoftirqd/223:15:262
2981112992917,8cyclictest231ktimers/123:35:261
2981112992914,4cyclictest131rcu_preempt23:15:161
298110799298,11cyclictest131rcu_preempt22:45:250
298110799298,11cyclictest11-21ksoftirqd/023:55:000
298110799295,4cyclictest131rcu_preempt23:30:250
2981107992922,5cyclictest3084914-21kworker/u8:3+events_unbound00:19:040
2981107992922,4cyclictest0-21swapper/020:25:280
2981107992920,4cyclictest0-21swapper/021:30:260
2981107992919,4cyclictest131rcu_preempt22:35:240
2981107992914,9cyclictest131rcu_preempt20:30:160
2981107992910,12cyclictest11-21ksoftirqd/000:00:000
2981120992821,4cyclictest0-21swapper/320:50:263
2981120992820,6cyclictest3054425-21kworker/u8:0+events_unbound22:42:013
2981120992816,8cyclictest0-21swapper/320:00:273
2981120992815,10cyclictest0-21swapper/321:15:133
2981120992812,10cyclictest3017755-21kworker/u8:1+events_unbound21:05:593
298111599287,12cyclictest32-21ksoftirqd/220:37:322
2981115992820,4cyclictest0-21swapper/220:30:182
2981115992819,5cyclictest0-21swapper/223:55:272
2981115992818,6cyclictest2993599-21basename19:45:022
2981112992813,4cyclictest131rcu_preempt22:55:011
2981112992810,11cyclictest24-21ksoftirqd/121:20:231
2981107992822,4cyclictest3073260-21kworker/u8:2+events_unbound23:35:220
2981107992816,3cyclictest131rcu_preempt21:37:550
298110799281,14cyclictest11-21ksoftirqd/020:20:240
2981120992721,4cyclictest2984810-21kworker/u8:0+events_unbound19:22:423
2981120992719,5cyclictest0-21swapper/320:45:133
2981120992719,4cyclictest0-21swapper/321:40:233
2981120992718,6cyclictest3083099-21grep00:00:273
2981120992718,6cyclictest0-21swapper/323:15:003
2981120992717,6cyclictest0-21swapper/320:05:243
2981120992716,5cyclictest3088939-21kworker/u8:0+events_unbound00:21:553
2981115992720,4cyclictest0-21swapper/221:40:242
2981115992719,5cyclictest3049256-21munin-plugin-st22:25:002
2981115992719,5cyclictest0-21swapper/219:15:032
2981115992719,5cyclictest0-21swapper/219:15:032
2981115992716,4cyclictest3011088-21kworker/u8:2+events_unbound20:49:502
2981115992714,4cyclictest3023247-21kworker/u8:2+events_unbound21:26:442
2981115992713,8cyclictest32-21ksoftirqd/220:05:222
2981115992711,7cyclictest32-21ksoftirqd/200:31:222
2981115992711,10cyclictest32-21ksoftirqd/219:20:182
298111299270,13cyclictest0-21swapper/120:25:141
298110799278,3cyclictest0-21swapper/000:22:420
298110799278,11cyclictest131rcu_preempt23:20:180
298110799278,11cyclictest11-21ksoftirqd/021:45:220
298110799277,6cyclictest131rcu_preempt00:10:240
298110799275,6cyclictest11-21ksoftirqd/021:40:230
298110799275,14cyclictest11-21ksoftirqd/023:45:260
298110799275,14cyclictest11-21ksoftirqd/023:45:250
2981120992620,4cyclictest2982422-21kworker/u8:1+events_unbound19:27:373
2981120992618,5cyclictest0-21swapper/322:50:263
2981120992618,5cyclictest0-21swapper/319:55:153
2981120992618,4cyclictest0-21swapper/320:10:293
2981120992617,6cyclictest0-21swapper/322:20:003
2981120992617,5cyclictest3095730-21sh00:40:003
2981120992616,7cyclictest3068229-21sendmail23:20:013
2981115992619,4cyclictest630-21snmpd21:55:182
2981115992617,5cyclictest0-21swapper/223:00:242
2981115992616,6cyclictest0-21swapper/221:00:012
2981115992616,6cyclictest0-21swapper/200:35:252
2981115992613,7cyclictest32-21ksoftirqd/221:05:002
2981107992614,9cyclictest3045699-21apt-config22:15:000
2981107992613,3cyclictest131rcu_preempt19:10:240
2981107992610,9cyclictest131rcu_preempt23:10:160
298110799260,6cyclictest3094266-21apt-get00:35:130
298112099255,11cyclictest131rcu_preempt19:45:163
2981120992519,4cyclictest3073260-21kworker/u8:2+events_unbound23:45:163
2981120992519,4cyclictest3073260-21kworker/u8:2+events_unbound23:45:153
2981120992517,4cyclictest0-21swapper/321:40:013
2981120992516,6cyclictest0-21swapper/322:00:263
2981120992514,8cyclictest3006430-21memory20:20:203
2981120992514,3cyclictest40-21ksoftirqd/321:25:013
298111599254,10cyclictest2982422-21kworker/u8:1+events_unbound19:27:272
2981115992515,7cyclictest3033260-21grep21:35:252
2981115992511,6cyclictest32-21ksoftirqd/222:25:222
298110799258,3cyclictest131rcu_preempt23:00:160
2981107992518,5cyclictest3030014-21kworker/u8:1+events_unbound21:53:530
2981107992518,5cyclictest3030014-21kworker/u8:1+events_unbound21:53:520
298112099245,8cyclictest131rcu_preempt00:10:173
2981120992416,4cyclictest3075411-21fschecks_count23:40:163
2981120992411,7cyclictest40-21ksoftirqd/323:00:223
2981120992410,8cyclictest131rcu_preempt22:11:573
2981120992410,3cyclictest131rcu_preempt23:30:233
2981115992418,4cyclictest2982422-21kworker/u8:1+events_unbound19:13:182
2981115992416,6cyclictest3082086-21kworker/u8:1+events_unbound00:15:182
298111599241,4cyclictest131rcu_preempt23:30:262
2981120992317,3cyclictest0-21swapper/319:35:263
2981120992315,5cyclictest0-21swapper/321:30:173
298112099231,11cyclictest3050908-21taskset22:27:013
2981115992313,7cyclictest32-21ksoftirqd/221:30:402
298112099221,5cyclictest3037083-21cron21:50:003
2981120992211,5cyclictest3023247-21kworker/u8:2+events_unbound21:28:223
298112099220,12cyclictest0-21swapper/322:35:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional