You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 02:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Sep 15, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1046642994834,9cyclictest1153998-21idleruntime-cro12:19:591
1046647994640,4cyclictest1062263-21kworker/u8:2+events_unbound07:54:212
1046647994638,6cyclictest1058754-21kworker/u8:2+events_unbound07:44:202
1046647994638,6cyclictest1058754-21kworker/u8:2+events_unbound07:44:202
1046642994635,6cyclictest1062046-21unixbench_multi07:50:251
1046638994635,8cyclictest1101972-21munin-plugin-st09:50:000
1046642994536,5cyclictest1091731-21sendmail09:20:011
104664299452,13cyclictest1079106-21grep08:40:261
1046647994436,5cyclictest1126277-21munin-plugin-st11:00:012
1046638994437,4cyclictest1050581-21munin-run07:20:000
1046638994433,8cyclictest1103694-21gpgv09:55:010
1046647994335,6cyclictest1088323-21munin-plugin-st09:10:012
1046642994332,7cyclictest1141623-21grep11:40:261
104664299431,10cyclictest1101168-21/usr/sbin/munin09:45:221
1046651994233,5cyclictest1129903-21munin-plugin-st11:10:003
1046647994232,7cyclictest1083567-21fschecks_count08:55:182
104664299427,5cyclictest0-21swapper/108:15:211
104664299422,8cyclictest1120985-21cron10:43:001
104664299421,11cyclictest1126169-21cron10:59:011
1046638994231,8cyclictest1119242-21sendmail10:40:010
1046651994130,8cyclictest1148864-21sh12:04:593
1046651994130,8cyclictest1140130-21sendmail11:40:003
1046651994130,8cyclictest1140130-21sendmail11:39:593
1046647994127,11cyclictest311ktimers/211:30:152
1046647994127,11cyclictest311ktimers/211:30:142
104664299412,7cyclictest1059106-21cron07:45:011
104664299412,7cyclictest1059106-21cron07:45:011
104664299411,9cyclictest1067173-21unixbench_multi08:05:261
104664299411,8cyclictest1055926-21/usr/sbin/munin07:35:171
104664299411,13cyclictest1140400-21ls11:40:011
104664299411,13cyclictest1140400-21ls11:40:011
104664299411,10cyclictest1121398-21apt-get10:45:121
104664299411,10cyclictest1117766-21apt-get10:35:131
1046647994034,4cyclictest1115535-21kworker/u8:0+events_unbound10:44:552
104664299402,6cyclictest1060807-21cron07:50:011
104664299401,9cyclictest1147545-21fschecks_count12:00:161
104664299401,9cyclictest1099401-21/usr/sbin/munin09:40:221
104664299401,7cyclictest1053987-21cron07:30:011
104664299401,10cyclictest629-21snmpd07:13:051
104664299401,10cyclictest1144297-21/usr/sbin/munin11:50:191
104664299401,10cyclictest1117187-21sh10:31:001
104664299401,10cyclictest1096471-21seq09:30:381
104664299401,10cyclictest1050944-21/usr/sbin/munin07:20:171
1046638994029,7cyclictest1160811-21sendmail12:40:000
1046651993924,5cyclictest131rcu_preempt09:52:173
1046651993922,5cyclictest131rcu_preempt07:24:553
1046647993932,4cyclictest1098550-21munin-plugin-st09:40:012
1046647993930,5cyclictest0-21swapper/211:25:252
1046647993930,5cyclictest0-21swapper/211:25:242
104664299398,5cyclictest1126844-21/usr/sbin/munin11:00:191
104664299397,3cyclictest0-21swapper/109:20:121
104664299392,6cyclictest1143302-21unixbench_multi11:45:271
104664299392,5cyclictest1086985-21cut09:05:161
104664299391,9cyclictest1107482-21cat10:05:011
104664299391,8cyclictest1130290-21cut11:10:171
104664299391,8cyclictest1103677-21cut09:54:591
104664299391,7cyclictest438-21cron08:35:011
104664299391,7cyclictest1124556-21cron10:55:011
104664299391,6cyclictest1098117-21grep09:35:271
104664299391,13cyclictest1050573-21sh07:20:011
104664299391,11cyclictest1147143-21cron12:00:011
104664299391,11cyclictest1079934-21diskstats08:45:161
104664299391,11cyclictest1054672-21meminfo07:30:181
104664299391,10cyclictest1159470-21fschecks_count12:35:151
104664299391,10cyclictest1083964-21grep08:55:221
1046647993831,4cyclictest1127984-21sh11:05:002
1046647993827,7cyclictest0-21swapper/209:55:012
104664299383,8cyclictest1115714-21seq10:28:471
104664299383,6cyclictest1105571-21cron10:00:011
104664299382,6cyclictest1110235-21unixbench_multi10:10:241
104664299382,6cyclictest1095146-21latency_hist09:30:001
104664299381,9cyclictest1131949-21diskstats11:15:151
104664299381,8cyclictest1068006-21fschecks_count08:10:161
104664299381,7cyclictest1090013-21cron09:15:011
104664299381,7cyclictest1074037-21grep08:25:261
104664299381,5cyclictest1111938-21grep10:15:241
1046642993814,21cyclictest0-21swapper/111:30:231
1046642993814,21cyclictest0-21swapper/111:30:221
1046642993813,22cyclictest1155928-21/usr/sbin/munin12:25:181
1046642993813,22cyclictest1155928-21/usr/sbin/munin12:25:181
1046642993811,22cyclictest0-21swapper/108:50:251
104664299381,11cyclictest1113222-21ntp_states10:20:211
104664299381,10cyclictest1150928-21df_inode12:10:191
1046651993724,4cyclictest131rcu_preempt08:15:163
1046651993717,4cyclictest131rcu_preempt10:00:233
1046647993731,4cyclictest1069014-21kworker/u8:0+events_unbound08:14:242
1046647993730,4cyclictest1046629-21cyclictest10:24:492
1046647993726,6cyclictest0-21swapper/207:15:012
1046647993721,5cyclictest131rcu_preempt10:40:002
1046647993711,5cyclictest131rcu_preempt08:20:142
104664299373,6cyclictest1149671-21ntp_states12:05:211
104664299372,5cyclictest164-21systemd-journal11:20:021
104664299371,9cyclictest1085709-21ntp_states09:00:221
104664299371,8cyclictest1108379-21cat10:05:241
104664299371,7cyclictest1154475-21/usr/sbin/munin12:20:161
104664299371,7cyclictest1076535-21fschecks_count08:35:181
104664299371,5cyclictest438-21cron11:10:001
104664299371,11cyclictest1072967-21date08:25:011
104664299371,10cyclictest1157819-21sort12:30:191
104664299371,10cyclictest1157819-21sort12:30:191
104664299371,10cyclictest1064118-21cron07:59:001
1046638993725,8cyclictest0-21swapper/011:39:590
1046638993725,8cyclictest0-21swapper/011:39:590
1046651993623,5cyclictest131rcu_preempt11:45:203
1046647993626,6cyclictest1096433-21grep09:30:262
1046647993617,5cyclictest131rcu_preempt10:15:122
104664299364,6cyclictest0-21swapper/108:00:211
104664299362,5cyclictest1136257-21unixbench_multi11:25:251
104664299362,5cyclictest1136257-21unixbench_multi11:25:251
1046638993629,4cyclictest1148879-21munin-run12:04:590
1046638993628,5cyclictest1091722-21sh09:20:010
1046651993528,5cyclictest1077514-21kworker/u8:1+events_unbound08:46:413
1046651993527,4cyclictest0-21swapper/312:25:003
1046651993525,7cyclictest391ktimers/311:55:123
1046651993522,5cyclictest131rcu_preempt08:07:573
1046651993515,10cyclictest131rcu_preempt10:00:003
1046647993525,6cyclictest0-21swapper/208:55:002
1046647993522,5cyclictest1133093-21kworker/u8:1+events_unbound11:23:432
1046638993527,4cyclictest0-21swapper/007:35:010
104665199349,14cyclictest0-21swapper/311:35:013
104665199349,14cyclictest0-21swapper/311:35:013
1046651993421,4cyclictest131rcu_preempt10:33:423
1046651993416,4cyclictest131rcu_preempt08:56:313
1046651993415,3cyclictest131rcu_preempt10:35:253
1046651993414,9cyclictest131rcu_preempt09:13:173
1046651993414,5cyclictest131rcu_preempt11:24:593
1046651993413,11cyclictest131rcu_preempt10:20:223
1046647993427,5cyclictest1120925-21kworker/u8:1+events_unbound10:49:582
1046647993426,4cyclictest0-21swapper/208:15:252
1046647993426,3cyclictest0-21swapper/210:05:242
1046647993418,4cyclictest131rcu_preempt07:15:052
1046647993416,4cyclictest131rcu_preempt11:09:172
1046647993410,11cyclictest32-21ksoftirqd/211:50:282
1046638993427,4cyclictest1112432-21sendmail10:20:010
1046638993427,4cyclictest0-21swapper/012:29:590
1046638993427,4cyclictest0-21swapper/012:29:590
1046638993427,3cyclictest0-21swapper/010:25:240
104665199334,7cyclictest40-21ksoftirqd/310:30:003
1046651993325,5cyclictest391ktimers/309:00:133
1046651993325,4cyclictest0-21swapper/309:45:003
1046651993325,4cyclictest0-21swapper/309:19:333
1046651993323,7cyclictest381rcuc/310:09:383
1046651993323,7cyclictest381rcuc/307:59:003
1046651993321,8cyclictest1098063-21grep09:35:263
1046647993323,6cyclictest0-21swapper/211:10:272
1046647993323,6cyclictest0-21swapper/207:35:182
1046647993322,6cyclictest0-21swapper/211:15:262
1046647993322,4cyclictest131rcu_preempt10:04:462
1046647993320,5cyclictest131rcu_preempt11:40:152
1046647993318,4cyclictest131rcu_preempt08:34:132
1046647993317,5cyclictest131rcu_preempt11:58:452
1046647993316,5cyclictest131rcu_preempt07:45:102
1046647993312,10cyclictest32-21ksoftirqd/212:14:592
1046638993326,4cyclictest13550irq/42-30be0000.ethernet08:20:010
1046638993324,5cyclictest1150561-21cron12:10:000
104663899331,3cyclictest0-21swapper/011:45:150
104665199327,6cyclictest391ktimers/310:14:363
104665199326,8cyclictest40-21ksoftirqd/309:50:003
104665199325,7cyclictest40-21ksoftirqd/308:30:263
1046651993222,7cyclictest391ktimers/307:45:233
1046651993216,6cyclictest1094806-21kworker/u8:0+events_unbound09:28:163
1046651993216,5cyclictest1124342-21kworker/u8:0+events_unbound11:18:473
1046651993214,3cyclictest131rcu_preempt10:47:013
1046647993226,3cyclictest0-21swapper/210:00:012
1046647993224,6cyclictest1079253-21kworker/u8:0+events_unbound08:49:302
1046647993224,4cyclictest0-21swapper/212:35:172
1046647993214,5cyclictest131rcu_preempt08:25:182
1046647993213,3cyclictest131rcu_preempt10:50:252
1046638993225,3cyclictest0-21swapper/008:00:000
1046638993223,6cyclictest1048281-21cut07:15:010
104665199316,7cyclictest40-21ksoftirqd/311:10:183
104665199315,5cyclictest40-21ksoftirqd/311:40:053
104665199313,10cyclictest40-21ksoftirqd/311:00:183
104665199312,8cyclictest40-21ksoftirqd/311:00:003
1046651993124,3cyclictest0-21swapper/307:35:273
1046651993123,4cyclictest0-21swapper/308:40:253
1046651993121,7cyclictest391ktimers/312:10:223
1046651993121,7cyclictest391ktimers/310:15:173
1046651993121,7cyclictest391ktimers/309:05:153
1046651993120,8cyclictest391ktimers/308:20:263
1046651993119,4cyclictest131rcu_preempt11:50:143
1046651993117,6cyclictest1134856-21kworker/u8:2+events_unbound11:28:083
1046651993117,6cyclictest1134856-21kworker/u8:2+events_unbound11:28:073
1046651993116,6cyclictest1155619-21kworker/u8:1+events_unbound12:37:203
1046651993115,6cyclictest1118956-21kworker/u8:2+events_unbound10:40:283
104664799312,4cyclictest0-21swapper/207:55:152
1046647993122,5cyclictest0-21swapper/207:30:202
1046647993114,5cyclictest131rcu_preempt12:15:202
104664799310,6cyclictest1091716-21cron09:20:002
1046638993125,4cyclictest1095366-21kworker/u8:3+events_unbound09:39:400
1046638993124,3cyclictest13550irq/42-30be0000.ethernet11:30:000
1046638993124,3cyclictest13550irq/42-30be0000.ethernet11:30:000
104665199309,13cyclictest40-21ksoftirqd/307:15:133
104665199309,12cyclictest40-21ksoftirqd/307:40:143
104665199309,12cyclictest40-21ksoftirqd/307:40:143
104665199304,15cyclictest40-21ksoftirqd/308:35:243
1046651993024,3cyclictest391ktimers/307:10:213
1046651993023,3cyclictest0-21swapper/312:25:253
1046651993023,3cyclictest0-21swapper/312:25:243
1046651993021,7cyclictest391ktimers/312:05:193
1046651993021,5cyclictest1093040-21unixbench_singl09:20:243
1046651993020,7cyclictest391ktimers/307:50:193
1046651993015,9cyclictest131rcu_preempt08:25:233
1046651993010,11cyclictest131rcu_preempt12:17:213
104664799309,11cyclictest32-21ksoftirqd/209:00:172
104664799309,10cyclictest32-21ksoftirqd/209:20:152
104664799304,15cyclictest32-21ksoftirqd/212:25:002
1046647993024,4cyclictest1148559-21kworker/u8:2+events_unbound12:05:082
1046647993023,5cyclictest1095143-21cron09:30:012
1046647993021,5cyclictest0-21swapper/212:34:592
1046647993021,5cyclictest0-21swapper/212:34:592
1046647993018,6cyclictest1089704-21kworker/u8:1+events_unbound09:12:122
1046647993014,5cyclictest131rcu_preempt10:30:232
1046647993014,3cyclictest131rcu_preempt12:25:242
1046647993014,3cyclictest131rcu_preempt12:25:242
1046647993011,11cyclictest32-21ksoftirqd/208:35:262
1046638993022,5cyclictest0-21swapper/009:10:000
1046638993022,5cyclictest0-21swapper/007:40:000
1046638993021,4cyclictest0-21swapper/008:40:000
104665199298,7cyclictest40-21ksoftirqd/310:50:233
1046651992920,7cyclictest391ktimers/307:25:223
1046651992913,5cyclictest131rcu_preempt12:30:243
1046651992913,5cyclictest131rcu_preempt12:30:243
1046651992911,5cyclictest131rcu_preempt08:10:163
104664799299,4cyclictest131rcu_preempt09:45:232
104664799297,10cyclictest32-21ksoftirqd/208:05:262
104664799295,5cyclictest32-21ksoftirqd/207:28:242
1046647992923,4cyclictest1136588-21kworker/u8:0+events_unbound11:35:062
1046647992923,4cyclictest1136588-21kworker/u8:0+events_unbound11:35:062
1046647992922,4cyclictest0-21swapper/210:25:252
1046647992913,3cyclictest131rcu_preempt12:05:012
1046647992910,10cyclictest32-21ksoftirqd/207:20:262
1046647992910,10cyclictest131rcu_preempt08:00:142
1046638992921,4cyclictest0-21swapper/009:59:410
1046638992916,11cyclictest629-21snmpd08:30:130
104665199285,7cyclictest40-21ksoftirqd/309:30:243
104665199285,14cyclictest40-21ksoftirqd/308:00:213
104665199283,7cyclictest40-21ksoftirqd/308:55:013
1046651992818,7cyclictest391ktimers/307:30:203
104664799289,10cyclictest32-21ksoftirqd/208:40:212
104664799286,7cyclictest32-21ksoftirqd/209:45:002
1046647992810,11cyclictest32-21ksoftirqd/211:45:262
1046638992821,4cyclictest0-21swapper/011:40:260
1046638992821,4cyclictest0-21swapper/009:25:250
1046638992820,5cyclictest0-21swapper/010:05:250
1046638992819,6cyclictest1146699-21unixbench_multi11:55:240
104663899281,10cyclictest1120707-21grep10:40:250
1046647992710,4cyclictest131rcu_preempt10:10:112
1046638992720,4cyclictest1145448-21cron11:55:010
1046638992719,4cyclictest0-21swapper/010:14:470
1046638992617,6cyclictest0-21swapper/009:05:000
104663899260,5cyclictest0-21swapper/008:08:160
1046638992518,5cyclictest1062263-21kworker/u8:2+events_unbound08:42:070
1046638992518,3cyclictest0-21swapper/009:30:150
1046638992518,3cyclictest0-21swapper/008:46:320
1046638992517,5cyclictest0-21swapper/010:30:160
1046638992514,7cyclictest0-21swapper/010:45:250
104663899241,9cyclictest1061585-21ntpq07:50:210
1046638992418,4cyclictest11-21ksoftirqd/011:30:140
1046638992418,4cyclictest11-21ksoftirqd/011:30:140
104663899241,7cyclictest1158701-21unixbench_singl12:30:280
104663899241,7cyclictest1158701-21unixbench_singl12:30:280
1046638992417,3cyclictest0-21swapper/007:47:350
1046638992414,7cyclictest1154757-21ntpq12:20:190
1046638992414,7cyclictest1074042-21grep08:25:270
1046638992414,7cyclictest1067969-21seq08:10:140
104663899241,20cyclictest1072914-21latency_hist08:25:020
104663899241,20cyclictest0-21swapper/007:27:350
104663899241,19cyclictest0-21swapper/008:00:040
104663899240,20cyclictest0-21swapper/012:10:060
1046638992317,3cyclictest13550irq/42-30be0000.ethernet09:10:220
1046638992317,3cyclictest1092113-21fschecks_count09:20:140
1046638992315,5cyclictest0-21swapper/008:55:270
1046638992312,8cyclictest1130275-21cut11:10:180
104663899231,20cyclictest0-21swapper/011:00:230
104663899231,18cyclictest0-21swapper/011:24:530
104663899231,18cyclictest0-21swapper/011:16:060
104663899231,18cyclictest0-21swapper/009:43:340
104663899231,18cyclictest0-21swapper/008:50:490
104663899231,18cyclictest0-21swapper/007:41:250
104663899231,18cyclictest0-21swapper/007:41:240
104663899230,19cyclictest0-21swapper/010:57:580
104663899221,19cyclictest0-21swapper/010:50:290
104663899221,19cyclictest0-21swapper/007:20:050
104663899221,17cyclictest0-21swapper/011:07:330
104663899220,18cyclictest0-21swapper/010:02:000
1046638992114,4cyclictest1113672-21unixbench_multi10:20:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional