You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 07:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sun Apr 19, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1316355995142,5cyclictest1323910-21idleruntime-cro19:30:013
1316343995119,4cyclictest0-21swapper/022:55:260
1316355994936,9cyclictest391ktimers/321:55:133
1316355994839,6cyclictest1382099-21cron22:20:013
1316355994839,6cyclictest1382099-21cron22:20:013
1316346994737,5cyclictest1419869-21idleruntime-cro00:10:001
1316355994640,4cyclictest1385360-21kworker/u8:3+events_unbound23:38:293
1316355994640,4cyclictest1385360-21kworker/u8:3+events_unbound23:38:293
1316351994634,7cyclictest1361013-21grep21:15:252
1316343994634,9cyclictest1361515-21apt-config21:20:020
1316343994537,5cyclictest1351203-21munin-plugin-st20:50:000
1316355994436,4cyclictest1390852-21cron22:45:003
1316351994434,7cyclictest311ktimers/219:55:122
1316343994430,9cyclictest1340958-21sh20:20:010
1316355994321,19cyclictest391ktimers/300:13:223
1316355994225,14cyclictest391ktimers/323:23:123
1316346994234,5cyclictest1423698-21fschecks_time00:20:161
1316346994234,5cyclictest1423698-21fschecks_time00:20:161
1316346994231,7cyclictest1407907-21cron23:34:591
1316355994127,9cyclictest391ktimers/319:40:123
1316351994133,4cyclictest1365063-21latency_hist21:30:012
1316351994120,7cyclictest131rcu_preempt20:30:112
1316346994030,6cyclictest1364573-21grep21:25:231
1316343994033,4cyclictest1421557-21apt00:15:000
1316343994027,10cyclictest121ktimers/021:30:130
1316355993932,4cyclictest1332851-21runrttasks19:55:153
1316355993929,6cyclictest1368037-21unixbench_singl21:35:253
1316351993929,7cyclictest311ktimers/220:20:112
1316346993932,4cyclictest0-21swapper/119:15:011
1316346993931,4cyclictest0-21swapper/120:20:141
1316355993830,4cyclictest1385057-21unixbench_multi22:25:243
1316343993831,3cyclictest0-21swapper/023:20:000
1316343993831,3cyclictest0-21swapper/023:19:590
1316343993830,4cyclictest1327320-21sh19:40:000
1316343993830,4cyclictest1327320-21sh19:40:000
1316355993727,7cyclictest1422828-21grep00:15:243
1316355993727,6cyclictest1429607-21grep00:35:233
1316355993722,9cyclictest131rcu_preempt23:47:463
1316351993729,4cyclictest0-21swapper/223:50:172
1316343993730,4cyclictest1371886-21latency_hist21:50:010
1316355993620,3cyclictest131rcu_preempt22:35:273
1316346993623,10cyclictest1395965-21latency_hist23:00:011
1316343993627,4cyclictest0-21swapper/020:15:010
1316355993524,4cyclictest131rcu_preempt19:20:193
1316355993519,12cyclictest391ktimers/320:10:113
1316351993527,5cyclictest1347783-21sendmail20:40:002
1316351993525,7cyclictest1320571-21seq19:20:002
1316346993527,4cyclictest0-21swapper/122:35:261
1316343993528,4cyclictest1318320-21start-stop-daem19:15:010
131635599346,6cyclictest40-21ksoftirqd/321:05:163
1316355993426,4cyclictest0-21swapper/321:32:583
1316355993425,5cyclictest0-21swapper/323:34:593
1316355993421,5cyclictest131rcu_preempt22:35:013
1316355993415,4cyclictest131rcu_preempt20:19:543
1316351993426,5cyclictest1373586-21idleruntime-cro21:55:002
1316346993426,4cyclictest0-21swapper/123:15:161
1316346993426,4cyclictest0-21swapper/123:15:161
1316346993426,4cyclictest0-21swapper/119:20:011
1316343993425,4cyclictest0-21swapper/000:00:160
1316355993316,4cyclictest131rcu_preempt19:50:183
1316351993325,5cyclictest1317969-21cron19:15:002
1316346993327,4cyclictest1385360-21kworker/u8:3+events_unbound22:48:191
1316346993325,4cyclictest0-21swapper/121:15:161
1316346993325,4cyclictest0-21swapper/119:50:241
1316346993323,6cyclictest0-21swapper/100:25:261
1316346993322,8cyclictest1329020-21cron19:45:011
1316343993325,4cyclictest1423694-21seq00:20:160
1316343993325,4cyclictest1423694-21seq00:20:150
1316343993321,8cyclictest1330326-21grep19:45:260
131635599324,11cyclictest40-21ksoftirqd/300:05:163
1316355993224,5cyclictest391ktimers/323:18:143
1316355993224,5cyclictest391ktimers/323:18:143
1316355993224,5cyclictest0-21swapper/322:55:173
1316355993223,5cyclictest0-21swapper/300:00:003
1316355993217,5cyclictest131rcu_preempt19:35:193
1316355993217,5cyclictest131rcu_preempt19:35:193
1316355993217,3cyclictest131rcu_preempt23:55:003
1316355993216,4cyclictest131rcu_preempt00:21:483
1316355993216,4cyclictest131rcu_preempt00:21:483
1316355993211,5cyclictest131rcu_preempt23:05:183
1316355993211,3cyclictest131rcu_preempt20:40:273
131635599320,18cyclictest1375837-21taskset22:00:173
1316351993224,4cyclictest0-21swapper/223:24:592
1316351993222,6cyclictest0-21swapper/223:50:012
1316351993221,7cyclictest1321738-21grep19:20:252
1316346993223,5cyclictest0-21swapper/122:50:241
1316346993223,5cyclictest0-21swapper/120:25:161
1316346993222,6cyclictest1333705-21grep19:55:241
1316346993222,6cyclictest0-21swapper/121:00:221
1316346993222,6cyclictest0-21swapper/121:00:221
1316343993224,4cyclictest0-21swapper/023:34:590
1316343993224,4cyclictest0-21swapper/022:48:160
1316343993221,7cyclictest1373129-21grep21:50:250
131635599319,13cyclictest40-21ksoftirqd/323:10:233
1316355993125,4cyclictest1409518-21kworker/u8:0+events_unbound23:40:423
1316355993122,7cyclictest1357876-21kworker/u8:1+events_unbound21:10:243
1316355993122,7cyclictest1317779-21kworker/u8:3+events_unbound19:14:083
1316355993122,6cyclictest1383387-21grep22:20:263
1316355993122,6cyclictest1383387-21grep22:20:253
1316355993121,7cyclictest391ktimers/321:00:183
1316355993121,7cyclictest391ktimers/321:00:183
1316355993121,7cyclictest391ktimers/320:30:233
1316355993121,7cyclictest391ktimers/320:25:133
1316355993120,8cyclictest391ktimers/320:20:163
1316355993119,5cyclictest131rcu_preempt21:25:373
1316355993117,4cyclictest131rcu_preempt21:15:213
1316355993116,9cyclictest131rcu_preempt21:42:593
1316355993116,6cyclictest1352518-21kworker/u8:2+events_unbound20:55:373
1316355993114,10cyclictest131rcu_preempt23:25:123
1316351993125,4cyclictest1385360-21kworker/u8:3+events_unbound22:58:202
1316351993124,4cyclictest0-21swapper/219:50:162
1316351993123,4cyclictest0-21swapper/221:20:252
1316346993125,3cyclictest1332062-21kworker/u8:2+events_unbound20:02:401
1316346993122,6cyclictest1416002-21grep23:55:281
1316346993120,7cyclictest1408324-21grep23:35:161
1316346993120,7cyclictest1408324-21grep23:35:161
1316346993119,7cyclictest0-21swapper/123:05:251
1316343993123,5cyclictest1410894-21grep23:40:250
1316343993121,6cyclictest1344374-21auditctl20:30:000
131635599309,13cyclictest40-21ksoftirqd/321:49:443
131635599308,5cyclictest131rcu_preempt00:00:163
131635599306,5cyclictest40-21ksoftirqd/320:35:283
1316355993022,6cyclictest1428037-21kworker/u8:0+events_unbound00:32:423
1316355993019,8cyclictest381rcuc/322:11:223
1316355993017,6cyclictest1327091-21kworker/u8:0+events_unbound20:09:513
1316355993016,3cyclictest131rcu_preempt00:25:263
1316355993015,8cyclictest131rcu_preempt20:02:543
1316355993014,5cyclictest131rcu_preempt19:30:193
1316355993013,5cyclictest391ktimers/322:46:533
1316355993010,13cyclictest40-21ksoftirqd/320:45:143
1316355993010,12cyclictest40-21ksoftirqd/323:00:153
1316351993023,4cyclictest145-21jbd2/mmcblk1p2-800:15:162
1316351993023,4cyclictest0-21swapper/222:00:172
131634699307,4cyclictest13838592sed22:25:011
131634699307,4cyclictest13838592sed22:25:001
1316346993022,4cyclictest0-21swapper/121:40:261
1316346993020,5cyclictest0-21swapper/119:20:251
1316343993022,5cyclictest1368231-21kworker/u8:2+events_unbound21:43:000
1316343993018,8cyclictest1358012-21cron21:10:000
131635599299,12cyclictest40-21ksoftirqd/321:20:233
131635599297,5cyclictest131rcu_preempt22:50:113
1316355992915,4cyclictest131rcu_preempt22:05:203
1316355992915,4cyclictest131rcu_preempt19:45:133
1316355992913,9cyclictest131rcu_preempt20:50:133
1316355992912,4cyclictest131rcu_preempt21:50:173
1316351992922,4cyclictest0-21swapper/222:20:262
1316351992922,4cyclictest0-21swapper/222:20:262
1316346992921,4cyclictest0-21swapper/120:35:181
1316346992919,6cyclictest0-21swapper/100:40:011
1316343992921,4cyclictest0-21swapper/023:05:010
1316351992821,4cyclictest0-21swapper/223:15:242
1316351992821,4cyclictest0-21swapper/223:15:242
1316351992820,5cyclictest0-21swapper/221:10:162
1316351992820,4cyclictest0-21swapper/223:10:162
1316351992819,6cyclictest1377414-21tune2fs22:05:172
1316346992820,4cyclictest1325626-21idleruntime-cro19:35:001
1316346992819,6cyclictest0-21swapper/120:10:151
1316346992817,7cyclictest1-21systemd20:07:401
1316343992820,4cyclictest0-21swapper/019:50:220
1316351992721,3cyclictest0-21swapper/221:05:172
1316351992719,4cyclictest0-21swapper/220:25:162
1316351992718,6cyclictest0-21swapper/200:05:242
1316351992716,8cyclictest311ktimers/200:25:132
1316346992721,4cyclictest1350806-21kworker/u8:0+events_unbound20:52:521
1316346992721,3cyclictest0-21swapper/121:35:181
1316346992720,4cyclictest0-21swapper/100:15:241
1316346992718,4cyclictest0-21swapper/119:37:361
1316346992718,4cyclictest0-21swapper/119:37:361
1316346992717,7cyclictest1417690-21grep00:00:271
1316343992720,3cyclictest1430121-21kworker/u8:000:40:000
1316351992620,4cyclictest1383585-21kworker/u8:1+events_unbound22:35:142
1316351992620,3cyclictest0-21swapper/223:30:222
1316351992616,6cyclictest1406216-21ls23:30:002
1316351992615,8cyclictest1387484-21wc22:35:002
1316343992620,4cyclictest1366519-21kworker/u8:1+events_unbound22:08:060
1316343992619,3cyclictest0-21swapper/019:30:250
1316343992618,5cyclictest0-21swapper/021:00:000
131634399261,7cyclictest1363988-21latency21:25:180
1316343992617,5cyclictest0-21swapper/022:40:010
1316343992614,9cyclictest13850irq/36-mmc120:55:000
1316351992519,4cyclictest1320361-21kworker/u8:1+events_unbound19:32:382
1316351992519,3cyclictest0-21swapper/200:00:012
1316351992515,7cyclictest1338342-21ntp_states20:10:202
1316351992510,5cyclictest1392176-21kworker/u8:1+events_unbound22:50:322
1316346992518,3cyclictest0-21swapper/123:55:001
1316346992517,5cyclictest1354603-21munin-plugin-st21:00:011
1316343992519,3cyclictest13850irq/36-mmc123:40:000
1316343992519,3cyclictest13850irq/36-mmc123:39:590
1316343992519,2cyclictest0-21swapper/021:10:330
1316343992518,4cyclictest1411780-21fschecks_time23:45:140
1316343992518,3cyclictest0-21swapper/021:35:150
1316343992517,4cyclictest0-21swapper/020:10:010
1316343992515,7cyclictest0-21swapper/000:19:590
1316343992513,8cyclictest204-21dbus-daemon22:03:050
1316343992513,7cyclictest1356307-21cron21:05:010
1316343992513,7cyclictest1356307-21cron21:05:000
131635199245,9cyclictest0-21swapper/221:35:132
1316351992418,4cyclictest1416200-21kworker/u8:3+events_unbound00:23:392
1316351992418,4cyclictest1416200-21kworker/u8:3+events_unbound00:23:382
1316351992418,3cyclictest0-21swapper/222:10:152
1316351992418,3cyclictest0-21swapper/200:35:012
131635199241,7cyclictest1327759-21fschecks_time19:40:162
1316351992417,3cyclictest0-21swapper/221:40:252
1316351992417,3cyclictest0-21swapper/219:25:272
1316351992416,5cyclictest1410393-21awk23:40:192
1316351992415,6cyclictest1429529-21grep00:35:242
1316351992414,6cyclictest1385087-21grep22:25:242
131635199241,12cyclictest0-21swapper/200:00:162
131635199240,4cyclictest131rcu_preempt22:45:012
1316346992416,5cyclictest1358012-21cron21:10:001
1316346992414,6cyclictest0-21swapper/120:30:241
1316346992412,8cyclictest204-21dbus-daemon19:47:361
1316343992418,3cyclictest13850irq/36-mmc120:35:000
1316343992417,4cyclictest0-21swapper/020:05:010
1316343992417,3cyclictest0-21swapper/023:13:260
1316343992417,3cyclictest0-21swapper/022:25:200
131634399241,19cyclictest0-21swapper/000:09:550
1316351992317,4cyclictest1342604-21kworker/u8:1+events_unbound20:44:402
1316351992317,3cyclictest0-21swapper/221:00:152
1316351992317,3cyclictest0-21swapper/221:00:142
1316351992316,5cyclictest1380099-21kworker/u8:2+events_unbound22:18:412
1316351992316,5cyclictest1380099-21kworker/u8:2+events_unbound22:18:412
1316351992316,4cyclictest1409631-21idleruntime-cro23:40:002
1316351992316,4cyclictest1409631-21idleruntime-cro23:39:592
1316351992313,6cyclictest0-21swapper/220:55:262
1316346992317,3cyclictest0-21swapper/123:00:121
1316346992317,3cyclictest0-21swapper/122:25:241
1316346992316,4cyclictest1362101-21fschecks_time21:20:161
1316346992316,4cyclictest0-21swapper/122:00:161
1316346992315,4cyclictest1377446-21fschecks_time22:05:181
131634399234,15cyclictest13550irq/42-30be0000.ethernet23:55:130
131634399233,18cyclictest0-21swapper/020:44:120
1316343992317,3cyclictest13850irq/36-mmc122:00:010
1316343992316,4cyclictest1404062-21tail23:20:260
1316343992316,3cyclictest0-21swapper/019:25:510
1316343992315,5cyclictest0-21swapper/023:05:250
1316343992312,7cyclictest204-21dbus-daemon22:13:070
131634399231,18cyclictest0-21swapper/023:50:340
131634399231,18cyclictest0-21swapper/022:50:040
131634399231,18cyclictest0-21swapper/022:43:170
131634399231,18cyclictest0-21swapper/022:32:450
131634399231,18cyclictest0-21swapper/019:55:400
131634399230,19cyclictest0-21swapper/022:22:400
131634399230,19cyclictest0-21swapper/022:22:400
1316351992216,4cyclictest1393962-21kworker/u8:0+events_unbound23:06:122
1316351992216,4cyclictest1325302-21kworker/u8:2+events_unbound19:38:192
1316351992216,4cyclictest1325302-21kworker/u8:2+events_unbound19:38:182
1316351992216,3cyclictest0-21swapper/223:00:212
1316351992215,5cyclictest1361894-21kworker/u8:0+events_unbound21:31:262
1316351992215,5cyclictest1327091-21kworker/u8:0+events_unbound20:00:302
1316351992215,4cyclictest1351832-21latency20:50:192
1316346992216,3cyclictest0-21swapper/121:45:171
1316346992215,4cyclictest1427906-21grep00:30:251
1316346992215,4cyclictest1421564-21latency_hist00:14:591
1316346992213,5cyclictest0-21swapper/123:45:131
131634699221,18cyclictest629-21snmpd23:25:131
1316346992211,7cyclictest0-21swapper/122:45:001
1316346992211,7cyclictest0-21swapper/122:35:011
1316343992215,4cyclictest645-21runrttasks19:20:210
1316343992215,3cyclictest0-21swapper/021:23:340
1316343992215,3cyclictest0-21swapper/019:41:520
1316343992212,7cyclictest1405809-21grep23:25:260
131634399221,19cyclictest0-21swapper/000:25:230
1316343992211,7cyclictest0-21swapper/020:40:020
1316351992115,4cyclictest1416200-21kworker/u8:3+events_unbound00:11:162
1316351992115,4cyclictest1332062-21kworker/u8:2+events_unbound20:05:142
1316351992113,5cyclictest0-21swapper/220:15:022
1316351992110,8cyclictest1370525-21df_inode21:45:142
1316346992115,3cyclictest0-21swapper/123:10:231
1316346992115,3cyclictest0-21swapper/122:20:001
1316346992115,3cyclictest0-21swapper/122:20:001
1316346992115,3cyclictest0-21swapper/120:40:211
1316346992115,3cyclictest0-21swapper/119:25:211
1316346992113,5cyclictest1340539-21unixbench_singl20:15:241
1316346992110,8cyclictest1379018-21awk22:10:131
1316351992011,4cyclictest0-21swapper/221:55:252
131634699209,8cyclictest1409973-21seq23:40:131
1316346992014,3cyclictest0-21swapper/121:55:221
1316346992012,6cyclictest231ktimers/120:49:221
1316346992011,6cyclictest0-21swapper/123:20:261
1316343992011,5cyclictest0-21swapper/000:30:040
1316346991811,4cyclictest13721142sleep121:50:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional