You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 00:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Apr 09, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1195984995647,5cyclictest1246597-21munin-plugin-st09:35:012
1195989995035,11cyclictest391ktimers/308:55:133
1195979995041,5cyclictest1296666-21cron11:59:591
1195979994842,4cyclictest1177436-21kworker/u8:1+events_unbound08:30:531
1195979994735,9cyclictest1229436-21apt-config08:45:011
1195984994436,5cyclictest1212037-21cron07:55:012
1195984994435,5cyclictest0-21swapper/208:40:012
119597599441,36cyclictest0-21swapper/008:05:120
119597599441,11cyclictest1292206-21/usr/sbin/munin11:45:170
119597599441,11cyclictest1292206-21/usr/sbin/munin11:45:160
1195989994333,6cyclictest1241466-21apt09:20:013
1195979994331,4cyclictest131rcu_preempt10:37:291
1195975994331,9cyclictest1284751-21auditctl11:24:590
119597599431,5cyclictest1208875-21apt-get07:45:130
1195975994310,28cyclictest1204057-21/usr/sbin/munin07:30:160
1195979994233,6cyclictest1272392-21ls10:50:001
119597599423,36cyclictest1230855-21sshd08:45:380
119597599422,33cyclictest1236587-21apt-get09:05:130
119597599421,9cyclictest1304301-21/usr/sbin/munin12:20:200
119597599421,4cyclictest1281371-21apt-config11:15:020
119597599421,36cyclictest1298623-21/usr/sbin/munin12:05:090
119597599421,10cyclictest1294096-21/usr/sbin/munin11:50:210
119597599421,10cyclictest1294096-21/usr/sbin/munin11:50:210
119597599421,10cyclictest1234883-21apt-get09:00:110
1195984994128,9cyclictest311ktimers/212:05:112
119597599411,9cyclictest1285504-21/usr/sbin/munin11:25:200
119597599411,9cyclictest1267606-21/usr/sbin/munin10:35:140
119597599411,9cyclictest1196328-21apt-get07:10:140
119597599411,8cyclictest1296391-21sshd11:56:370
119597599411,35cyclictest1305499-21cpu12:25:140
119597599410,9cyclictest1212273-21apt-get07:55:130
119597599410,5cyclictest1241718-21apt-get09:20:120
119597599410,2cyclictest0-21swapper/009:50:080
1195989994024,13cyclictest391ktimers/312:10:023
1195984994030,5cyclictest0-21swapper/210:11:042
1195984994028,8cyclictest208-21systemd-logind11:41:162
119597599402,35cyclictest1208599-21sshd07:44:380
119597599401,7cyclictest1302163-21/usr/sbin/munin12:15:160
1195975994014,21cyclictest1265567-21idleruntime-cro10:30:010
119597599401,36cyclictest1247390-21ntp_states09:35:290
119597599400,9cyclictest1226131-21apt-get08:35:120
119597599400,35cyclictest1286987-21if_eth111:30:160
119597599400,2cyclictest0-21swapper/008:40:120
1195989993931,5cyclictest1289861-21munin-run11:40:003
1195989993918,14cyclictest131rcu_preempt07:45:023
1195979993930,6cyclictest1206942-21sendmail07:40:011
1195979993928,8cyclictest231ktimers/110:30:111
1195979993928,8cyclictest1248296-21sendmail09:40:011
119597599393,33cyclictest1259531-21ntp_states10:10:210
1195975993924,12cyclictest0-21swapper/010:55:140
119597599392,34cyclictest1290545-21/usr/sbin/munin11:40:190
119597599391,8cyclictest1238291-21apt-get09:10:130
119597599391,7cyclictest1261007-21/usr/sbin/munin10:15:170
119597599391,6cyclictest1288502-21/usr/sbin/munin11:35:150
119597599391,4cyclictest0-21swapper/008:00:110
119597599391,35cyclictest1269323-21df10:40:140
119597599391,35cyclictest1255837-21/usr/sbin/munin10:00:190
119597599391,35cyclictest1255837-21/usr/sbin/munin10:00:190
119597599391,35cyclictest1248837-21/usr/sbin/munin09:40:160
119597599391,35cyclictest1219420-21/usr/sbin/munin08:15:150
119597599391,35cyclictest1218060-21/usr/sbin/munin08:10:240
119597599391,35cyclictest1201915-21latency_hist07:25:020
119597599391,35cyclictest1198743-21df07:15:140
119597599391,34cyclictest1222914-21/usr/sbin/munin08:25:160
119597599391,33cyclictest1276285-21/usr/sbin/munin11:00:180
119597599391,33cyclictest1245112-21/usr/sbin/munin09:30:100
119597599391,33cyclictest1231574-21df_inode08:50:150
119597599391,32cyclictest1262393-21apt-get10:20:110
119597599391,2cyclictest0-21swapper/009:56:380
119597599391,10cyclictest1239993-21apt-get09:15:110
119597599390,4cyclictest0-21swapper/012:00:100
1195989993830,4cyclictest0-21swapper/312:10:013
1195979993827,5cyclictest131rcu_preempt07:40:271
1195979993820,4cyclictest0-21swapper/110:40:181
1195979993810,15cyclictest24-21ksoftirqd/109:00:011
119597599383,32cyclictest1211649-21users07:50:250
119597599381,6cyclictest1282743-21sshd11:16:360
119597599381,5cyclictest1278401-21/usr/sbin/munin11:05:210
119597599381,5cyclictest0-21swapper/009:45:120
119597599381,3cyclictest1221082-21/usr/sbin/munin08:20:130
119597599381,34cyclictest1257827-21/usr/sbin/munin10:05:210
119597599381,34cyclictest1203133-21users07:25:240
119597599381,32cyclictest1272736-21/usr/sbin/munin10:50:130
119597599381,11cyclictest1300327-21apt-get12:10:100
1195989993725,8cyclictest0-21swapper/310:25:003
1195989993725,7cyclictest0-21swapper/310:20:013
1195989993717,14cyclictest131rcu_preempt10:45:253
1195979993730,4cyclictest1251714-21idleruntime-cro09:49:591
1195979993717,5cyclictest131rcu_preempt10:25:131
1195979993717,10cyclictest131rcu_preempt08:48:011
119597599372,32cyclictest1265910-21diskstats10:30:130
119597599371,33cyclictest1307268-21diskstats12:30:150
119597599371,33cyclictest1271036-21/usr/sbin/munin10:45:140
119597599371,33cyclictest1224878-21memory08:30:190
119597599371,32cyclictest1205589-21fschecks_count07:35:140
119597599370,5cyclictest0-21swapper/009:25:120
119597599370,2cyclictest0-21swapper/008:55:120
1195989993625,7cyclictest1204753-21grep07:30:253
1195984993627,4cyclictest0-21swapper/212:00:002
1195979993621,10cyclictest131rcu_preempt07:30:211
1195979993619,9cyclictest131rcu_preempt11:00:151
1195979993619,11cyclictest131rcu_preempt07:15:051
1195979993615,11cyclictest131rcu_preempt07:20:131
1195979993615,10cyclictest131rcu_preempt11:15:001
1195989993526,5cyclictest0-21swapper/311:35:003
1195989993522,5cyclictest131rcu_preempt11:05:053
1195989993518,5cyclictest131rcu_preempt12:25:013
1195989993516,10cyclictest131rcu_preempt07:20:153
1195984993526,5cyclictest1208640-21auditctl07:45:002
1195984993525,6cyclictest1302188-21grep12:15:152
1195984993523,8cyclictest438-21cron10:10:012
1195979993528,5cyclictest1232687-21kworker/u8:1+events_unbound09:00:571
1195979993520,9cyclictest131rcu_preempt12:00:161
1195979993518,4cyclictest131rcu_preempt07:10:151
1195979993518,11cyclictest131rcu_preempt10:05:151
1195989993426,4cyclictest1283030-21sh11:20:013
1195989993426,4cyclictest0-21swapper/309:30:243
1195989993425,5cyclictest0-21swapper/309:40:013
1195989993425,4cyclictest0-21swapper/309:50:133
1195989993421,5cyclictest131rcu_preempt07:50:233
1195989993416,4cyclictest131rcu_preempt07:25:193
1195989993415,5cyclictest131rcu_preempt08:00:133
1195989993415,10cyclictest131rcu_preempt08:46:383
1195984993424,5cyclictest0-21swapper/208:45:152
1195984993423,7cyclictest0-21swapper/207:20:242
1195979993426,4cyclictest0-21swapper/109:15:581
1195979993426,4cyclictest0-21swapper/108:20:001
1195979993424,4cyclictest131rcu_preempt10:55:121
1195979993423,6cyclictest0-21swapper/107:45:251
1195979993423,5cyclictest131rcu_preempt08:30:011
1195979993421,8cyclictest131rcu_preempt08:38:021
1195979993418,8cyclictest131rcu_preempt11:49:081
1195979993418,8cyclictest131rcu_preempt11:49:081
1195979993417,6cyclictest131rcu_preempt08:50:251
1195979993415,11cyclictest131rcu_preempt12:35:001
119598999338,13cyclictest40-21ksoftirqd/307:35:193
1195989993327,4cyclictest1263625-21kworker/u8:0+events_unbound11:11:123
1195989993325,5cyclictest0-21swapper/308:40:013
1195989993318,9cyclictest131rcu_preempt12:15:223
1195989993318,4cyclictest131rcu_preempt07:10:263
1195989993314,5cyclictest131rcu_preempt08:10:293
1195989993314,12cyclictest131rcu_preempt07:45:173
1195989993314,11cyclictest131rcu_preempt10:10:043
1195984993323,6cyclictest0-21swapper/208:00:262
1195984993322,7cyclictest1266858-21grep10:30:242
119597999337,22cyclictest231ktimers/112:15:251
1195979993326,5cyclictest1246473-21kworker/u8:1+events_unbound10:00:411
1195979993326,5cyclictest1246473-21kworker/u8:1+events_unbound10:00:411
1195979993318,9cyclictest131rcu_preempt09:05:161
1195979993317,3cyclictest131rcu_preempt12:25:181
1195979993317,10cyclictest131rcu_preempt12:05:131
1195979993316,4cyclictest131rcu_preempt12:20:171
1195979993314,11cyclictest131rcu_preempt11:40:211
1195979993313,9cyclictest131rcu_preempt08:20:171
1195979993313,4cyclictest131rcu_preempt10:15:521
1195979993313,10cyclictest131rcu_preempt10:50:151
119598999327,4cyclictest391ktimers/310:59:593
1195989993220,9cyclictest391ktimers/311:45:113
1195989993220,9cyclictest391ktimers/311:45:113
1195989993220,5cyclictest131rcu_preempt08:15:243
1195989993219,5cyclictest131rcu_preempt09:25:233
1195989993214,11cyclictest131rcu_preempt10:40:163
1195989993213,11cyclictest131rcu_preempt10:30:223
1195989993212,6cyclictest40-21ksoftirqd/311:55:193
1195989993211,13cyclictest131rcu_preempt09:10:243
1195979993220,4cyclictest131rcu_preempt12:38:501
1195979993218,8cyclictest131rcu_preempt11:15:061
1195979993215,3cyclictest0-21swapper/111:36:461
1195979993215,10cyclictest131rcu_preempt11:20:151
1195979993215,10cyclictest131rcu_preempt07:57:521
1195979993212,11cyclictest0-21swapper/109:58:461
1195979993210,12cyclictest131rcu_preempt09:30:241
119598999318,4cyclictest0-21swapper/308:40:233
1195989993121,4cyclictest131rcu_preempt10:05:013
1195989993118,5cyclictest131rcu_preempt10:00:143
1195989993118,5cyclictest131rcu_preempt10:00:133
1195989993116,3cyclictest131rcu_preempt11:25:243
1195989993115,5cyclictest131rcu_preempt09:20:273
1195989993115,3cyclictest131rcu_preempt11:04:023
1195989993115,3cyclictest131rcu_preempt09:08:283
1195989993114,9cyclictest131rcu_preempt12:35:013
1195989993112,10cyclictest131rcu_preempt08:30:153
1195989993111,12cyclictest131rcu_preempt12:40:003
1195989993110,7cyclictest40-21ksoftirqd/308:50:253
1195989993110,12cyclictest131rcu_preempt11:24:473
1195984993123,4cyclictest0-21swapper/211:50:232
1195984993123,4cyclictest0-21swapper/211:50:232
119597999316,13cyclictest0-21swapper/109:20:271
1195979993124,4cyclictest0-21swapper/110:10:231
1195979993120,4cyclictest131rcu_preempt11:30:021
1195979993114,8cyclictest131rcu_preempt09:25:221
1195979993114,10cyclictest131rcu_preempt11:27:351
1195979993114,10cyclictest131rcu_preempt09:10:171
1195979993113,5cyclictest131rcu_preempt08:00:261
1195979993111,6cyclictest131rcu_preempt08:10:261
1195979993111,12cyclictest131rcu_preempt09:50:141
1195979993110,13cyclictest131rcu_preempt09:40:151
119598999304,7cyclictest40-21ksoftirqd/309:55:153
1195989993021,6cyclictest381rcuc/309:47:363
1195989993020,7cyclictest391ktimers/311:40:163
1195989993020,7cyclictest381rcuc/309:02:523
1195989993014,9cyclictest131rcu_preempt07:55:333
1195989993014,5cyclictest131rcu_preempt12:25:183
1195989993014,5cyclictest131rcu_preempt10:40:013
1195989993013,5cyclictest131rcu_preempt12:00:123
1195989993013,4cyclictest131rcu_preempt10:50:113
1195989993010,5cyclictest131rcu_preempt08:20:223
1195989993010,14cyclictest1195966-21cyclictest07:15:053
1195989993010,13cyclictest131rcu_preempt08:25:153
1195984993022,6cyclictest1270625-21kworker/u8:1+events_unbound10:46:102
1195984993022,5cyclictest1222495-21sh08:25:012
1195984993022,5cyclictest0-21swapper/210:25:162
1195984993022,4cyclictest0-21swapper/208:55:272
1195984993021,5cyclictest0-21swapper/208:10:012
1195984993020,6cyclictest0-21swapper/211:00:252
119597999309,12cyclictest131rcu_preempt11:50:171
119597999309,12cyclictest131rcu_preempt11:50:171
119597999307,14cyclictest24-21ksoftirqd/108:05:241
1195979993024,4cyclictest221rcuc/107:50:201
1195979993019,4cyclictest131rcu_preempt10:20:201
1195979993018,5cyclictest131rcu_preempt11:05:141
1195979993012,9cyclictest131rcu_preempt07:27:201
1195989992918,4cyclictest131rcu_preempt10:25:223
1195984992922,5cyclictest1287864-21kworker/u8:0+events_unbound11:36:182
1195984992922,4cyclictest0-21swapper/208:50:252
1195984992922,3cyclictest0-21swapper/210:00:002
1195984992921,4cyclictest0-21swapper/209:10:002
1195984992920,6cyclictest1297361-21grep12:00:172
1195984992920,6cyclictest0-21swapper/209:25:252
1195984992915,9cyclictest204-21dbus-daemon10:36:072
1195979992912,3cyclictest0-21swapper/112:11:081
1195989992821,4cyclictest391ktimers/311:50:343
1195989992821,4cyclictest391ktimers/311:50:343
1195989992811,10cyclictest131rcu_preempt08:05:123
1195984992821,3cyclictest0-21swapper/207:10:132
1195984992818,6cyclictest311ktimers/210:00:202
1195984992818,6cyclictest311ktimers/210:00:192
1195984992817,7cyclictest0-21swapper/207:45:252
1195984992717,5cyclictest0-21swapper/208:40:522
1195984992518,3cyclictest0-21swapper/210:50:242
1195984992517,5cyclictest311ktimers/207:35:252
1195984992517,4cyclictest0-21swapper/211:45:242
1195984992517,4cyclictest0-21swapper/211:45:242
1195984992517,4cyclictest0-21swapper/208:35:012
1195984992517,4cyclictest0-21swapper/207:15:152
1195984992516,7cyclictest311ktimers/211:05:052
1195984992516,7cyclictest1239613-21kworker/u8:2-events_unbound09:25:012
1195984992516,6cyclictest1235113-21tune2fs09:00:152
1195984992516,5cyclictest0-21swapper/209:15:162
1195984992514,7cyclictest1287691-21grep11:30:232
119598499242,15cyclictest1251277-21head09:45:252
1195984992417,4cyclictest0-21swapper/210:20:212
1195984992416,5cyclictest0-21swapper/211:15:252
1195984992413,7cyclictest204-21dbus-daemon09:51:032
1195984992412,7cyclictest0-21swapper/207:55:322
1195984992315,5cyclictest0-21swapper/211:10:142
1195984992315,5cyclictest0-21swapper/207:25:142
1195984992315,4cyclictest1300506-21fschecks_count12:10:152
1195984992314,6cyclictest0-21swapper/209:10:162
1195984992311,9cyclictest1219527-21cut08:15:162
1195984992215,3cyclictest0-21swapper/211:20:122
119598499212,14cyclictest1308626-21munin-run12:35:012
1195984992115,3cyclictest0-21swapper/212:20:222
1195984992115,3cyclictest0-21swapper/210:55:172
1195984992114,5cyclictest311ktimers/209:35:152
1195984992114,5cyclictest1306986-21sort12:30:012
1195984992113,5cyclictest0-21swapper/208:25:172
1195984992014,4cyclictest311ktimers/210:40:152
1195984992013,3cyclictest0-21swapper/207:30:182
1195984992011,4cyclictest0-21swapper/212:35:252
1195984991912,4cyclictest1217790-21cut08:10:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional