You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 12:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Wed Nov 26, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1380656995728,24cyclictest0-21swapper/221:20:012
1380656995722,7cyclictest0-21swapper/219:30:012
1380656995328,7cyclictest1447691-21cron22:20:002
1380646994943,4cyclictest1387710-21kworker/u8:1+events_unbound19:42:010
1380661994840,5cyclictest1478807-21cron23:49:593
1380661994835,10cyclictest391ktimers/323:55:133
1380661994633,10cyclictest391ktimers/322:20:143
1380646994624,17cyclictest0-21swapper/023:00:000
1380661994531,10cyclictest391ktimers/320:05:123
1380652994538,4cyclictest1405917-21idleruntime-cro20:20:011
1380652994538,4cyclictest1405917-21idleruntime-cro20:20:011
1380652994538,3cyclictest1468585-21sendmail23:20:011
1380656994329,10cyclictest311ktimers/223:30:122
1380646994336,4cyclictest1438950-21auditctl21:55:000
1380646994235,5cyclictest1405605-21kworker/u8:0+events_unbound20:17:080
1380646994235,5cyclictest1405605-21kworker/u8:0+events_unbound20:17:080
1380661994130,7cyclictest1423379-21cron21:10:013
1380661994031,5cyclictest1457929-21idleruntime-cro22:50:013
1380656994030,8cyclictest440-21cron22:10:012
1380652994033,4cyclictest1436631-21unixbench_singl21:45:261
1380652993931,4cyclictest0-21swapper/121:05:251
1380646993932,5cyclictest1492355-21kworker/u8:1+events_unbound00:38:010
1380646993927,9cyclictest121ktimers/019:10:150
1380661993826,9cyclictest391ktimers/322:05:153
1380652993831,5cyclictest1393350-21kworker/u8:0+events_unbound19:47:041
1380646993826,9cyclictest121ktimers/020:30:140
1380661993727,5cyclictest0-21swapper/300:00:313
1380652993730,3cyclictest0-21swapper/100:05:161
1380652993728,6cyclictest0-21swapper/122:00:001
1380652993727,7cyclictest1429732-21grep21:25:241
1380656993624,7cyclictest0-21swapper/200:00:002
1380652993628,5cyclictest1438940-21cron21:55:001
1380652993625,7cyclictest1431516-21grep21:30:281
1380652993625,7cyclictest0-21swapper/123:00:011
1380646993628,5cyclictest1426807-21munin-run21:20:010
1380661993526,4cyclictest0-21swapper/323:10:263
1380656993527,4cyclictest0-21swapper/220:15:012
1380652993528,5cyclictest1409103-21kworker/u8:1+events_unbound20:35:431
1380652993527,5cyclictest1476639-21unixbench_multi23:40:261
1380652993527,4cyclictest0-21swapper/120:25:261
1380646993529,3cyclictest0-21swapper/020:15:010
1380646993528,5cyclictest1468331-21kworker/u8:2+events_unbound23:17:410
138064699351,5cyclictest131rcu_preempt20:50:140
138064699351,5cyclictest131rcu_preempt20:50:130
1380661993425,6cyclictest0-21swapper/320:40:003
1380656993426,4cyclictest0-21swapper/221:25:232
1380656993426,4cyclictest0-21swapper/220:00:272
1380652993428,4cyclictest146-21jbd2/mmcblk1p2-820:55:421
1380652993426,4cyclictest0-21swapper/119:30:181
1380652993424,7cyclictest1486852-21grep00:10:261
1380646993427,3cyclictest0-21swapper/019:20:000
1380646993425,5cyclictest0-21swapper/020:05:010
138064699341,4cyclictest131rcu_preempt23:45:120
1380661993325,4cyclictest0-21swapper/320:50:263
1380661993325,4cyclictest0-21swapper/320:50:253
1380661993324,4cyclictest0-21swapper/321:40:263
1380656993323,5cyclictest0-21swapper/200:00:222
1380646993327,3cyclictest1412757-21kworker/u8:120:40:000
1380646993325,6cyclictest1442197-21kworker/u8:2+events_unbound22:12:300
1380646993324,6cyclictest0-21swapper/000:05:000
1380646993323,6cyclictest0-21swapper/021:00:000
1380661993224,4cyclictest0-21swapper/319:40:013
1380661993223,5cyclictest0-21swapper/300:10:013
1380661993221,7cyclictest1442577-21sh22:05:013
1380656993224,4cyclictest0-21swapper/222:35:162
1380652993226,4cyclictest1457568-21kworker/u8:1+events_unbound22:49:431
1380652993222,7cyclictest1448948-21grep22:20:271
1380652993222,6cyclictest0-21swapper/122:35:261
1380652993221,7cyclictest1466411-21grep23:10:251
1380652993220,8cyclictest1-21systemd19:11:551
138064699329,4cyclictest131rcu_preempt23:05:150
138064699324,4cyclictest131rcu_preempt19:55:120
138064699324,4cyclictest131rcu_preempt19:55:120
138064699322,4cyclictest131rcu_preempt21:55:120
1380646993224,4cyclictest0-21swapper/020:05:240
1380661993123,4cyclictest0-21swapper/323:40:263
1380661993123,4cyclictest0-21swapper/323:05:283
1380661993123,4cyclictest0-21swapper/319:10:273
1380661993123,4cyclictest0-21swapper/300:25:263
1380661993119,7cyclictest1487333-21sh00:15:003
1380656993124,4cyclictest1391622-21munin-run19:40:012
1380656993124,3cyclictest0-21swapper/222:55:252
1380656993124,3cyclictest0-21swapper/222:30:162
1380656993124,3cyclictest0-21swapper/222:30:162
1380656993123,4cyclictest0-21swapper/200:35:322
1380652993124,5cyclictest1403856-21kworker/u8:2+events_unbound20:13:431
1380652993124,3cyclictest0-21swapper/119:40:011
1380652993123,4cyclictest1376734-21kworker/u8:1+events_unbound19:16:561
1380652993123,4cyclictest0-21swapper/123:50:251
1380652993123,4cyclictest0-21swapper/123:50:251
1380652993120,7cyclictest1387586-21grep19:25:281
138065299310,5cyclictest131rcu_preempt22:00:121
1380646993122,6cyclictest1473290-21grep23:30:260
1380646993122,6cyclictest0-21swapper/023:15:010
1380646993122,5cyclictest0-21swapper/023:35:250
1380661993022,4cyclictest0-21swapper/323:00:173
1380661993022,4cyclictest0-21swapper/323:00:163
1380661993021,6cyclictest1431913-21sh21:35:013
1380661993021,5cyclictest0-21swapper/323:40:003
1380661993021,4cyclictest0-21swapper/321:00:263
1380661993020,6cyclictest1480086-21unixbench_singl23:50:253
1380661993020,6cyclictest1480086-21unixbench_singl23:50:253
1380661993019,7cyclictest0-21swapper/319:50:263
1380656993022,4cyclictest0-21swapper/220:50:172
1380656993022,4cyclictest0-21swapper/220:50:172
1380656993022,4cyclictest0-21swapper/200:20:012
1380656993021,7cyclictest1440058-21timerandwakeup21:55:242
1380656993021,6cyclictest0-21swapper/221:10:012
1380656993021,6cyclictest0-21swapper/220:40:002
138065299302,5cyclictest131rcu_preempt23:20:141
1380652993023,3cyclictest0-21swapper/119:45:011
1380652993020,6cyclictest0-21swapper/100:34:591
1380646993023,3cyclictest0-21swapper/019:25:270
1380646993020,6cyclictest0-21swapper/019:40:010
1380646993019,7cyclictest1431517-21grep21:30:290
138064699301,5cyclictest131rcu_preempt21:00:140
1380661992921,4cyclictest0-21swapper/320:25:253
1380656992919,6cyclictest0-21swapper/223:45:002
1380652992922,4cyclictest0-21swapper/122:25:241
1380652992922,4cyclictest0-21swapper/121:25:011
1380652992919,6cyclictest0-21swapper/123:50:001
138065299291,4cyclictest131rcu_preempt22:30:121
138065299291,4cyclictest131rcu_preempt22:30:121
138064699292,4cyclictest131rcu_preempt00:25:140
1380646992923,4cyclictest1391376-21kworker/u8:2+events_unbound19:52:040
1380646992923,3cyclictest0-21swapper/023:30:000
1380646992922,4cyclictest1454046-21grep22:35:260
1380646992921,6cyclictest1438750-21kworker/u8:0+events_unbound22:00:250
1380646992920,6cyclictest0-21swapper/023:00:240
1380646992920,6cyclictest0-21swapper/023:00:240
1380646992918,7cyclictest1422960-21grep21:05:250
1380661992821,3cyclictest0-21swapper/322:25:163
1380661992821,3cyclictest0-21swapper/321:45:253
1380661992820,4cyclictest0-21swapper/323:30:003
1380661992820,4cyclictest0-21swapper/322:55:163
1380661992820,4cyclictest0-21swapper/320:30:273
1380661992820,4cyclictest0-21swapper/319:20:253
1380661992819,4cyclictest0-21swapper/321:20:193
1380656992822,4cyclictest1380639-21cyclictest20:30:142
1380656992821,3cyclictest0-21swapper/220:59:592
1380656992820,4cyclictest0-21swapper/222:40:272
138065699281,3cyclictest131rcu_preempt21:35:162
1380652992822,4cyclictest1382065-21kworker/u8:0+events_unbound19:21:581
1380652992822,3cyclictest0-21swapper/100:20:011
1380652992819,6cyclictest0-21swapper/121:00:251
1380652992812,6cyclictest1459600-21kworker/u8:0+events_unbound23:37:411
1380646992822,4cyclictest1476859-21kworker/u8:2+events_unbound23:42:450
1380646992822,4cyclictest0-21swapper/022:45:250
1380646992822,3cyclictest0-21swapper/023:50:250
1380646992822,3cyclictest0-21swapper/023:50:250
1380646992822,3cyclictest0-21swapper/000:10:250
1380646992821,4cyclictest0-21swapper/022:20:000
1380646992820,4cyclictest0-21swapper/021:10:260
138064699281,12cyclictest0-21swapper/022:06:000
1380661992719,5cyclictest0-21swapper/321:30:013
1380661992719,4cyclictest0-21swapper/320:20:253
1380661992719,4cyclictest0-21swapper/320:20:253
1380661992718,6cyclictest0-21swapper/322:00:003
1380656992720,4cyclictest0-21swapper/220:15:272
1380656992720,4cyclictest0-21swapper/220:15:262
1380656992720,4cyclictest0-21swapper/219:15:242
1380656992719,5cyclictest0-21swapper/220:20:162
1380656992719,5cyclictest0-21swapper/220:20:162
1380656992719,4cyclictest0-21swapper/200:30:012
1380656992718,5cyclictest0-21swapper/219:30:262
1380656992717,6cyclictest0-21swapper/223:45:262
1380656992711,13cyclictest311ktimers/222:10:162
138065299277,10cyclictest24-21ksoftirqd/120:30:221
1380652992720,5cyclictest1417916-21kworker/u8:0+events_unbound21:18:471
1380652992719,6cyclictest1400343-21kworker/u8:3+events_unbound20:05:031
1380646992721,3cyclictest0-21swapper/021:25:010
1380646992720,5cyclictest0-21swapper/020:45:010
1380646992720,3cyclictest0-21swapper/021:40:010
1380646992716,8cyclictest1487574-21seq00:15:130
1380661992619,4cyclictest1389430-21unixbench_multi19:30:273
1380661992619,3cyclictest0-21swapper/321:50:153
1380661992618,5cyclictest0-21swapper/319:15:233
1380661992618,4cyclictest0-21swapper/323:15:263
1380661992618,4cyclictest0-21swapper/322:35:253
1380661992618,4cyclictest0-21swapper/320:05:013
1380661992618,4cyclictest0-21swapper/319:45:263
138066199261,21cyclictest1398430-21grep19:55:253
138066199261,21cyclictest1398430-21grep19:55:253
1380656992619,5cyclictest1431848-21kworker/u8:2+events_unbound21:47:252
1380656992619,3cyclictest0-21swapper/200:10:162
1380656992616,7cyclictest1398872-21ls20:00:012
1380656992616,7cyclictest1398872-21ls20:00:002
138065699261,5cyclictest131rcu_preempt23:35:112
1380656992615,8cyclictest1396708-21grep19:50:262
1380656992614,7cyclictest215-21dbus-daemon22:02:262
138065299269,3cyclictest131rcu_preempt00:05:001
138065299267,10cyclictest0-21swapper/120:50:221
138065299267,10cyclictest0-21swapper/120:50:221
1380652992620,3cyclictest0-21swapper/122:50:191
1380652992615,7cyclictest231ktimers/123:30:121
1380652992614,8cyclictest0-21swapper/123:10:011
1380652992610,6cyclictest24-21ksoftirqd/100:25:251
1380646992619,4cyclictest0-21swapper/000:30:240
1380646992618,6cyclictest1482234-21sendmail00:00:000
1380646992617,5cyclictest0-21swapper/022:32:560
1380646992617,5cyclictest0-21swapper/022:32:550
1380646992617,5cyclictest0-21swapper/022:27:310
1380646992617,5cyclictest0-21swapper/021:28:010
1380646992614,8cyclictest215-21dbus-daemon23:22:420
1380661992518,4cyclictest0-21swapper/319:25:273
1380656992518,4cyclictest1490767-21munin-plugin-st00:25:002
1380656992518,4cyclictest0-21swapper/220:25:262
1380656992516,6cyclictest1448989-21unixbench_singl22:20:262
1380656992516,6cyclictest1401142-21diskstats20:05:142
1380656992516,6cyclictest0-21swapper/220:45:012
1380652992519,4cyclictest1494391-21kworker/u8:0+events_unbound00:39:141
1380652992518,5cyclictest1450892-21kworker/u8:2+events_unbound23:01:351
1380652992518,5cyclictest1450892-21kworker/u8:2+events_unbound23:01:351
1380652992518,5cyclictest1409103-21kworker/u8:1+events_unbound20:40:121
1380652992518,5cyclictest1405605-21kworker/u8:0+events_unbound20:22:481
1380652992518,5cyclictest1405605-21kworker/u8:0+events_unbound20:22:471
1380652992518,5cyclictest1400213-21kworker/u8:0+events_unbound20:01:511
1380652992518,4cyclictest0-21swapper/119:50:261
1380652992517,4cyclictest0-21swapper/122:15:251
138064699258,14cyclictest151rcuc/000:20:250
1380646992519,4cyclictest1450892-21kworker/u8:2+events_unbound22:50:220
1380646992519,3cyclictest0-21swapper/020:20:250
1380646992519,3cyclictest0-21swapper/020:20:240
1380646992518,5cyclictest1387710-21kworker/u8:1+events_unbound19:32:240
1380661992418,3cyclictest0-21swapper/323:20:223
138066199241,6cyclictest14034152sendmail_mailqu20:10:273
1380661992416,4cyclictest0-21swapper/322:40:283
1380661992414,6cyclictest0-21swapper/322:10:283
1380661992412,4cyclictest4048818-1kworker/3:1H+kblockd19:45:023
1380652992418,4cyclictest1476859-21kworker/u8:2+events_unbound23:59:311
1380652992417,3cyclictest0-21swapper/123:25:271
1380652992417,3cyclictest0-21swapper/121:10:171
1380652992416,5cyclictest1428419-21kworker/u8:1+events_unbound21:37:361
1380652992414,6cyclictest0-21swapper/121:40:261
1380646992418,4cyclictest1449129-21kworker/u8:1+events_unbound22:23:290
1380646992417,3cyclictest0-21swapper/021:45:320
138064699241,19cyclictest0-21swapper/022:43:010
138064699241,19cyclictest0-21swapper/000:05:340
1380661992316,4cyclictest0-21swapper/300:35:003
1380661992313,6cyclictest1490806-21seq00:25:013
1380661992312,8cyclictest1415332-21idleruntime20:45:183
1380656992317,3cyclictest0-21swapper/219:10:232
1380656992316,4cyclictest311ktimers/223:00:122
1380656992316,4cyclictest311ktimers/223:00:122
1380656992316,3cyclictest0-21swapper/219:20:252
1380656992316,3cyclictest0-21swapper/200:05:252
1380656992315,5cyclictest0-21swapper/221:50:172
1380656992315,4cyclictest0-21swapper/222:50:232
1380656992313,7cyclictest1457382-21sed22:45:252
1380652992312,8cyclictest1445081-21ntp_states22:10:241
138064699236,6cyclictest1384909-21cpuspeed19:20:140
138064699231,18cyclictest0-21swapper/021:44:440
138064699231,18cyclictest0-21swapper/019:47:560
1380661992214,5cyclictest0-21swapper/322:35:003
1380661992214,5cyclictest0-21swapper/322:35:003
1380661992214,4cyclictest0-21swapper/321:40:013
1380656992216,3cyclictest0-21swapper/220:45:242
1380656992215,4cyclictest1427187-21fschecks_count21:20:182
1380656992214,5cyclictest0-21swapper/200:35:002
1380656992214,4cyclictest0-21swapper/223:10:012
1380656992213,6cyclictest0-21swapper/223:20:282
1380656992213,6cyclictest0-21swapper/221:10:182
1380656992210,8cyclictest1479206-21grep23:50:152
1380656992210,8cyclictest1479206-21grep23:50:142
138065299226,3cyclictest131rcu_preempt00:20:251
1380652992216,4cyclictest1442197-21kworker/u8:2+events_unbound22:06:361
1380652992216,3cyclictest0-21swapper/119:55:161
1380652992216,3cyclictest0-21swapper/119:55:151
138064699221,17cyclictest0-21swapper/020:26:060
1380661992115,3cyclictest0-21swapper/322:20:013
1380661992114,4cyclictest1414701-21apt-key20:45:013
1380661992114,4cyclictest1405640-21run-parts20:17:013
1380661992114,4cyclictest1405640-21run-parts20:17:013
1380661992114,3cyclictest0-21swapper/300:35:223
1380661992114,3cyclictest0-21swapper/300:15:233
1380661992111,7cyclictest1423786-21grep21:10:173
1380656992114,4cyclictest1431515-21unixbench_singl21:30:292
1380661992014,4cyclictest391ktimers/320:55:343
1380661992014,3cyclictest0-21swapper/323:30:233
1380661992013,4cyclictest0-21swapper/322:50:233
1380656992014,4cyclictest311ktimers/219:45:122
1380656992014,3cyclictest0-21swapper/222:30:002
1380656992012,3cyclictest1466410-21unixbench_multi23:10:262
1380652992011,6cyclictest0-21swapper/122:40:201
1380656991914,3cyclictest1467101-21/usr/sbin/munin23:15:192
1380656991914,3cyclictest1420214-21/usr/sbin/munin21:00:182
1380656991914,3cyclictest0-21swapper/223:30:002
1380656991812,3cyclictest1435423-21latency_hist21:45:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional