You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 18:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Dec 24, 2025 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1138139995544,7cyclictest1150204-21grep07:40:253
1138139995143,5cyclictest1164490-21munin-plugin-st08:25:003
1138139995139,8cyclictest1165915-21grep08:25:253
1138125995143,4cyclictest1237174-21munin-plugin-st11:55:000
1138129995038,8cyclictest1197531-21sendmail10:00:011
1138125995043,5cyclictest1223251-21kworker/u8:2+events_unbound11:25:150
1138129994935,5cyclictest1187169-21kworker/u8:0+events_unbound10:30:071
113812999474,11cyclictest24-21ksoftirqd/111:20:121
1138131994632,11cyclictest311ktimers/212:20:122
1138131994332,7cyclictest1242097-21unixbench_singl12:05:262
1138129994229,9cyclictest1217736-21grep10:55:261
1138129994229,9cyclictest1188571-21grep09:30:271
1138129994134,4cyclictest1218647-21runrttasks11:00:181
1138139994030,6cyclictest1210688-21grep10:35:273
1138131994033,4cyclictest1233560-21munin-plugin-st11:45:012
1138131994032,4cyclictest0-21swapper/208:00:002
1138129994031,4cyclictest0-21swapper/107:50:021
1138125994030,6cyclictest1-21systemd08:54:470
1138125993929,6cyclictest0-21swapper/011:10:160
1138139993831,4cyclictest1152334-21munin-plugin-st07:50:013
1138139993827,7cyclictest0-21swapper/310:55:253
1138131993827,7cyclictest0-21swapper/211:25:252
1138125993829,6cyclictest1158031-21fschecks_count08:05:160
1138125993826,8cyclictest1165940-21grep08:25:250
1138139993726,8cyclictest1209449-21auditctl10:35:003
1138139993726,7cyclictest0-21swapper/309:20:013
1138139993725,9cyclictest391ktimers/312:30:133
1138131993729,4cyclictest0-21swapper/207:20:012
1138131993729,4cyclictest0-21swapper/207:20:012
1138129993729,5cyclictest1185628-21latency_hist09:25:001
1138129993729,5cyclictest1185628-21latency_hist09:25:001
1138129993726,8cyclictest1200923-21idleruntime-cro10:10:001
1138129993724,10cyclictest231ktimers/108:10:131
1138125993725,7cyclictest1238884-21sendmail12:00:000
1138139993629,4cyclictest1237577-21fschecks_count11:55:173
1138139993626,7cyclictest1205599-21grep10:20:253
1138139993625,7cyclictest0-21swapper/312:25:263
1138129993629,4cyclictest0-21swapper/110:45:001
1138129993627,5cyclictest0-21swapper/107:55:021
1138125993629,4cyclictest1211162-21munin-plugin-st10:40:010
1138125993620,13cyclictest11-21ksoftirqd/010:45:110
1138139993527,4cyclictest0-21swapper/310:00:183
1138139993526,6cyclictest1244394-21cron12:14:593
1138139993526,6cyclictest1244394-21cron12:14:593
1138139993526,5cyclictest0-21swapper/309:40:003
1138139993525,6cyclictest0-21swapper/309:25:263
1138139993511,15cyclictest0-21swapper/310:05:193
1138131993526,5cyclictest1231845-21idleruntime-cro11:40:002
1138129993528,5cyclictest1247562-21kworker/u8:0+events_unbound12:25:271
1138129993525,6cyclictest0-21swapper/107:35:251
1138125993518,14cyclictest11-21ksoftirqd/007:45:120
1138139993425,6cyclictest0-21swapper/310:45:243
1138139993425,5cyclictest1193658-21grep09:45:243
1138139993424,7cyclictest1174506-21grep08:50:253
1138131993426,4cyclictest0-21swapper/211:20:012
1138129993428,4cyclictest1231592-21kworker/u8:1+events_unbound11:40:191
1138129993428,4cyclictest1174779-21kworker/u8:2+events_unbound09:19:541
1138129993422,8cyclictest1172770-21grep08:45:251
1138125993427,5cyclictest1141798-21kworker/u8:2+events_unbound07:19:280
1138125993427,5cyclictest1141798-21kworker/u8:2+events_unbound07:19:280
1138125993426,4cyclictest0-21swapper/012:30:280
1138125993422,7cyclictest0-21swapper/010:30:260
1138131993325,3cyclictest0-21swapper/210:35:172
1138129993324,5cyclictest1180931-21runrttasks09:10:201
1138129993324,5cyclictest1180931-21runrttasks09:10:201
1138129993323,6cyclictest1194109-21idleruntime-cro09:50:001
1138125993325,5cyclictest1190689-21munin-plugin-st09:40:010
1138125993325,4cyclictest13550irq/42-30be0000.ethernet12:35:170
1138125993323,7cyclictest1240790-21sh12:05:010
1138125993323,7cyclictest1170574-21tr08:40:200
1138125993322,7cyclictest1179766-21unixbench_multi09:05:230
1138125993322,7cyclictest1179766-21unixbench_multi09:05:230
1138125993315,14cyclictest11-21ksoftirqd/011:35:140
1138139993222,4cyclictest131rcu_preempt09:40:193
1138139993217,3cyclictest131rcu_preempt11:35:153
1138131993223,4cyclictest0-21swapper/207:15:012
1138129993224,4cyclictest0-21swapper/112:30:261
1138125993225,3cyclictest0-21swapper/012:10:260
1138125993225,3cyclictest0-21swapper/012:10:260
113813999316,8cyclictest40-21ksoftirqd/311:05:123
113813999316,7cyclictest40-21ksoftirqd/311:20:213
1138139993123,4cyclictest0-21swapper/309:00:183
1138139993121,7cyclictest1222876-21grep11:10:263
1138139993120,7cyclictest1148508-21grep07:35:273
1138139993117,3cyclictest131rcu_preempt08:30:453
1138139993115,4cyclictest131rcu_preempt08:09:113
1138131993124,4cyclictest0-21swapper/209:30:262
1138131993124,3cyclictest0-21swapper/209:55:272
1138131993124,3cyclictest0-21swapper/208:15:272
1138131993123,4cyclictest0-21swapper/208:10:012
1138131993122,5cyclictest0-21swapper/210:45:252
1138131993121,6cyclictest0-21swapper/208:45:262
1138131993120,7cyclictest1193677-21grep09:45:232
1138129993125,4cyclictest1174779-21kworker/u8:2+events_unbound09:02:401
1138129993122,6cyclictest164-21systemd-journal08:54:481
1138129993121,7cyclictest0-21swapper/111:10:001
1138125993125,3cyclictest0-21swapper/011:50:000
1138125993120,7cyclictest0-21swapper/009:25:000
1138125993120,7cyclictest0-21swapper/009:25:000
113813999306,9cyclictest40-21ksoftirqd/308:20:003
113813999304,7cyclictest40-21ksoftirqd/312:20:143
113813999304,7cyclictest40-21ksoftirqd/311:15:133
1138139993022,5cyclictest391ktimers/311:42:413
1138139993022,5cyclictest1227183-21fschecks_time11:25:163
1138139993021,5cyclictest0-21swapper/309:10:253
1138139993021,5cyclictest0-21swapper/309:10:253
1138131993023,3cyclictest0-21swapper/210:15:262
1138131993022,4cyclictest0-21swapper/208:30:012
1138131993021,5cyclictest1250971-21grep12:30:262
1138131993020,7cyclictest0-21swapper/212:00:002
1138131993018,7cyclictest0-21swapper/212:00:162
1138129993022,6cyclictest1162229-21timerwakeupswit08:15:261
1138129993022,4cyclictest0-21swapper/112:25:001
1138129993022,4cyclictest0-21swapper/108:09:371
1138129993021,6cyclictest1143601-21kworker/u8:1+events_unbound07:25:141
1138129993021,5cyclictest0-21swapper/107:25:011
1138129993021,5cyclictest0-21swapper/107:25:011
1138129993020,7cyclictest1241188-21cut12:05:171
1138129993018,8cyclictest1253226-21runrttasks12:40:011
1138129993011,7cyclictest131rcu_preempt11:10:121
1138125993023,3cyclictest0-21swapper/012:15:240
1138125993019,7cyclictest0-21swapper/009:20:010
1138125993019,6cyclictest1146743-21grep07:30:270
113813999298,5cyclictest40-21ksoftirqd/312:05:253
113813999298,13cyclictest131rcu_preempt07:25:243
113813999295,6cyclictest40-21ksoftirqd/310:10:183
1138139992920,6cyclictest391ktimers/311:45:133
1138139992920,5cyclictest0-21swapper/308:00:173
1138131992922,4cyclictest1195797-21cron09:55:012
1138131992921,4cyclictest0-21swapper/208:55:182
1138131992921,4cyclictest0-21swapper/207:40:262
1138131992920,4cyclictest0-21swapper/209:00:262
1138131992920,4cyclictest0-21swapper/207:20:292
1138131992920,4cyclictest0-21swapper/207:20:282
1138131992919,7cyclictest1145497-21cron07:30:002
1138131992916,10cyclictest1206055-21basename10:25:012
1138129992919,7cyclictest231ktimers/109:25:061
1138129992918,8cyclictest0-21swapper/108:30:441
1138129992916,5cyclictest1139463-21kworker/u8:0+events_unbound07:13:391
1138125992921,4cyclictest0-21swapper/007:50:150
1138125992918,7cyclictest1164014-21grep08:20:240
113813999288,7cyclictest40-21ksoftirqd/310:40:153
113813999286,6cyclictest40-21ksoftirqd/309:05:193
113813999286,6cyclictest40-21ksoftirqd/309:05:193
113813999286,4cyclictest381rcuc/312:03:333
113813999284,8cyclictest40-21ksoftirqd/308:35:213
1138139992821,4cyclictest1155527-21head07:55:273
1138139992815,5cyclictest131rcu_preempt12:39:073
1138139992814,3cyclictest131rcu_preempt07:20:053
1138139992814,3cyclictest131rcu_preempt07:20:053
1138131992822,3cyclictest0-21swapper/211:10:002
1138131992821,4cyclictest0-21swapper/212:15:002
1138131992821,4cyclictest0-21swapper/212:15:002
1138131992819,5cyclictest1235902-21grep11:50:152
113813199281,6cyclictest0-21swapper/211:10:122
113812999284,3cyclictest131rcu_preempt10:10:131
1138129992820,5cyclictest1228438-21idleruntime-cro11:30:011
1138129992820,4cyclictest0-21swapper/112:20:011
113812999281,3cyclictest131rcu_preempt08:20:121
1138129992813,4cyclictest131rcu_preempt11:31:401
1138125992824,2cyclictest13550irq/42-30be0000.ethernet10:15:160
1138125992821,4cyclictest1166851-21fschecks_time08:30:450
1138125992821,3cyclictest0-21swapper/008:55:190
1138125992815,9cyclictest1155972-21basename08:00:010
113813999276,7cyclictest40-21ksoftirqd/312:15:243
113813999276,6cyclictest381rcuc/307:13:033
113813999274,9cyclictest40-21ksoftirqd/309:55:143
113813999274,12cyclictest40-21ksoftirqd/311:50:553
113813999273,6cyclictest40-21ksoftirqd/307:50:233
113813999272,7cyclictest40-21ksoftirqd/308:10:173
1138139992722,2cyclictest0-21swapper/310:15:233
1138139992721,4cyclictest1138119-21cyclictest11:30:173
113813999271,9cyclictest40-21ksoftirqd/308:45:123
1138139992717,7cyclictest0-21swapper/309:25:013
1138139992717,7cyclictest0-21swapper/309:25:003
1138139992716,8cyclictest1176610-21cron09:00:003
1138139992715,4cyclictest131rcu_preempt09:31:253
1138131992719,5cyclictest0-21swapper/209:25:262
1138131992719,4cyclictest0-21swapper/209:40:252
1138131992719,4cyclictest0-21swapper/208:00:162
1138131992715,8cyclictest1164520-21latency_hist08:25:002
113812999275,11cyclictest24-21ksoftirqd/109:40:171
1138129992720,5cyclictest1187169-21kworker/u8:0+events_unbound09:50:191
1138129992720,5cyclictest1187169-21kworker/u8:0+events_unbound09:39:151
1138129992717,6cyclictest0-21swapper/112:00:251
113812999271,5cyclictest131rcu_preempt07:15:121
113812999271,5cyclictest131rcu_preempt07:15:121
1138129992712,5cyclictest1205749-21kworker/u8:1+events_unbound10:21:261
113812999271,13cyclictest0-21swapper/110:29:291
1138125992720,4cyclictest13550irq/42-30be0000.ethernet07:40:010
1138125992719,5cyclictest0-21swapper/012:05:180
1138125992719,3cyclictest0-21swapper/010:05:000
113813999266,6cyclictest40-21ksoftirqd/309:50:233
113813999265,7cyclictest40-21ksoftirqd/308:40:123
1138139992616,6cyclictest0-21swapper/307:35:013
1138131992617,6cyclictest0-21swapper/209:40:012
1138131992616,6cyclictest1148486-21grep07:35:262
1138129992619,5cyclictest1194073-21kworker/u8:2+events_unbound10:00:221
1138129992619,4cyclictest0-21swapper/107:30:261
1138129992616,7cyclictest1244003-21grep12:10:261
1138129992616,7cyclictest1244003-21grep12:10:261
1138129992611,4cyclictest221rcuc/111:55:271
1138125992618,4cyclictest12014982sleep010:10:200
1138125992617,5cyclictest0-21swapper/008:20:000
1138125992616,6cyclictest0-21swapper/011:05:010
1138131992518,3cyclictest0-21swapper/210:00:272
1138131992517,5cyclictest311ktimers/210:29:142
113812999258,10cyclictest24-21ksoftirqd/111:15:111
113812999252,4cyclictest131rcu_preempt11:40:001
1138129992521,2cyclictest0-21swapper/110:35:141
1138129992516,7cyclictest1224992-21kworker/u8:0+events_unbound11:45:051
1138129992516,6cyclictest204-21dbus-daemon08:59:481
113812999251,12cyclictest0-21swapper/108:37:301
1138125992516,5cyclictest0-21swapper/012:26:460
1138125992514,6cyclictest1187734-21fschecks_time09:30:170
113813999249,4cyclictest131rcu_preempt10:50:123
113813999240,7cyclictest40-21ksoftirqd/307:15:023
113813999240,7cyclictest40-21ksoftirqd/307:15:013
1138131992419,3cyclictest1138119-21cyclictest11:20:132
1138131992418,3cyclictest0-21swapper/210:45:002
1138131992417,4cyclictest1252226-21ntpq12:35:222
1138131992417,3cyclictest0-21swapper/211:45:182
1138131992417,3cyclictest0-21swapper/208:40:012
1138131992416,4cyclictest1209461-21munin-plugin-st10:35:002
1138131992416,4cyclictest1152693-21fschecks_count07:50:152
113813199241,21cyclictest311ktimers/212:15:192
1138129992418,4cyclictest1187169-21kworker/u8:0+events_unbound10:52:091
1138129992417,5cyclictest1187169-21kworker/u8:0+events_unbound10:48:001
1138129992416,6cyclictest1149495-21kworker/u8:0+events_unbound07:42:281
113812999241,12cyclictest0-21swapper/109:08:201
113812999241,12cyclictest0-21swapper/109:08:201
1138129992410,4cyclictest131rcu_preempt08:00:211
1138125992418,4cyclictest1149495-21kworker/u8:0+events_unbound08:04:390
1138125992418,3cyclictest0-21swapper/010:40:260
1138125992418,3cyclictest0-21swapper/009:55:230
1138125992418,3cyclictest0-21swapper/007:40:180
1138125992417,3cyclictest0-21swapper/011:30:290
1138125992417,3cyclictest0-21swapper/010:20:210
1138125992415,6cyclictest0-21swapper/007:25:240
1138125992413,7cyclictest1138609-21/usr/sbin/munin07:10:160
113812599241,19cyclictest0-21swapper/011:09:530
113812599241,19cyclictest0-21swapper/009:46:160
1138131992316,5cyclictest311ktimers/209:20:112
1138131992316,5cyclictest311ktimers/209:20:112
1138131992315,5cyclictest0-21swapper/211:30:282
1138131992315,4cyclictest0-21swapper/210:50:272
1138131992314,7cyclictest1249801-21sed12:30:002
1138129992317,3cyclictest0-21swapper/110:15:181
1138129992312,8cyclictest1236256-21ntp_states11:50:211
113812599233,18cyclictest0-21swapper/009:26:580
113812599231,9cyclictest1168649-21/usr/sbin/munin08:35:170
1138125992316,4cyclictest1172814-21unixbench_singl08:45:250
1138125992315,3cyclictest0-21swapper/010:30:000
113812599231,20cyclictest0-21swapper/009:10:130
113812599231,20cyclictest0-21swapper/009:10:120
113812599231,18cyclictest0-21swapper/011:24:160
113812599231,18cyclictest0-21swapper/010:56:290
113812599231,18cyclictest0-21swapper/009:52:000
113812599231,18cyclictest0-21swapper/007:20:500
113812599231,18cyclictest0-21swapper/007:20:500
113812599230,19cyclictest0-21swapper/011:42:420
113812599230,19cyclictest0-21swapper/010:05:350
1138131992216,4cyclictest1213104-21kworker/u8:2+events_unbound10:55:112
1138131992214,6cyclictest1166800-21fschecks_count08:30:432
1138131992213,5cyclictest0-21swapper/208:50:252
1138125992216,3cyclictest0-21swapper/009:05:010
113812599220,18cyclictest0-21swapper/012:20:360
1138131992114,4cyclictest629-21snmpd11:00:122
1138131992113,5cyclictest0-21swapper/208:40:172
1138129992115,4cyclictest1160981-21kworker/u8:3+events_unbound08:28:181
113812599211,3cyclictest0-21swapper/010:53:570
113813199209,8cyclictest1159696-21df08:10:152
1138131992015,3cyclictest0-21swapper/209:05:242
1138131992015,3cyclictest0-21swapper/209:05:242
1138131992012,5cyclictest0-21swapper/209:15:262
113813199201,16cyclictest1150859-21apt-get07:45:142
1138131991913,4cyclictest311ktimers/209:15:002
1138131991913,4cyclictest311ktimers/209:15:002
1138131991910,7cyclictest1146482-21grep07:30:242
113813199189,6cyclictest1200715-21seq10:07:332
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional