You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 08:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Fri Sep 18, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1140697999313,76cyclictest1143681-21/usr/sbin/munin19:25:202
1140697998346,33cyclictest1155416-21grep20:30:282
1140697997534,35cyclictest0-21swapper/220:30:002
1140697996924,36cyclictest0-21swapper/219:40:202
1140695996754,11cyclictest231ktimers/122:45:201
1140697996420,38cyclictest0-21swapper/220:00:302
114069599622,37cyclictest22-21rcuc/123:35:001
1140697996114,9cyclictest1188845-21apt-get23:50:022
1140695996140,14cyclictest231ktimers/121:55:131
1140697995926,27cyclictest0-21swapper/222:25:242
1140693995924,6cyclictest0-21swapper/019:40:010
1140697995717,6cyclictest0-21swapper/221:30:212
1140697995618,5cyclictest0-21swapper/200:00:332
114069599565,10cyclictest1141654-21munin-node19:15:011
1140697995526,25cyclictest167550irq/134-8000000.ethernet-tx220:55:262
1140697995526,25cyclictest167550irq/134-8000000.ethernet-tx220:55:252
1140697995517,5cyclictest0-21swapper/220:15:292
114069399551,4cyclictest0-21swapper/019:10:020
1140697995418,5cyclictest0-21swapper/223:40:302
1140697995416,7cyclictest0-21swapper/200:05:312
114069799534,15cyclictest1162226-21grep21:10:292
114069799534,15cyclictest1162226-21grep21:10:292
1140697995330,19cyclictest1173401-21grep22:15:302
1140697995320,26cyclictest0-21swapper/221:35:282
1140697995320,26cyclictest0-21swapper/221:35:272
114069399531,3cyclictest0-21swapper/022:45:020
1140697995224,4cyclictest167550irq/134-8000000.ethernet-tx200:23:102
1140697995218,9cyclictest0-21swapper/221:45:012
1140697995218,9cyclictest0-21swapper/221:45:012
1140695995234,11cyclictest231ktimers/122:15:131
114069799514,12cyclictest0-21swapper/223:35:252
1140697995129,16cyclictest0-21swapper/222:00:292
1140697995124,20cyclictest0-21swapper/220:55:012
1140697995119,8cyclictest0-21swapper/223:25:292
1140695995142,5cyclictest1192402-21munin-plugin-st00:10:011
1140695995142,4cyclictest205-21ptp000:35:291
1140695995142,4cyclictest205-21ptp000:35:291
114069799503,12cyclictest1147590-21tail19:45:282
114069799503,12cyclictest1147590-21tail19:45:282
114069799501,9cyclictest0-21swapper/222:50:002
1140697995019,3cyclictest0-21swapper/222:25:022
1140697995017,8cyclictest1660-21snmpd23:51:002
1140697995016,8cyclictest0-21swapper/219:50:222
1140695995030,13cyclictest231ktimers/119:45:151
1140695995030,13cyclictest231ktimers/119:45:151
1140695995024,15cyclictest231ktimers/120:00:121
1140693995043,4cyclictest167350irq/118-8000000.ethernet-tx023:35:150
1140693995039,7cyclictest0-21swapper/021:00:220
1140693995031,15cyclictest167350irq/118-8000000.ethernet-tx023:05:200
1140697994918,5cyclictest0-21swapper/220:25:012
1140697994917,8cyclictest1190638-21http00:00:002
1140697994916,6cyclictest311ktimers/221:20:222
114069799491,27cyclictest0-21swapper/220:05:272
114069599491,10cyclictest0-21swapper/121:45:011
114069599491,10cyclictest0-21swapper/121:45:011
114069399499,21cyclictest12-21ksoftirqd/022:55:000
1140693994941,4cyclictest1175103-21grep22:25:260
1140693994940,5cyclictest20650irq/252-8000000.ethernet20:00:000
1140693994940,5cyclictest20650irq/252-8000000.ethernet20:00:000
1140693994937,5cyclictest167350irq/118-8000000.ethernet-tx023:10:160
1140693994937,5cyclictest167350irq/118-8000000.ethernet-tx023:10:160
114069799483,13cyclictest1186082-21sed23:30:302
1140697994820,3cyclictest0-21swapper/219:15:032
1140697994814,7cyclictest0-21swapper/221:15:292
1140693994840,4cyclictest20650irq/252-8000000.ethernet20:55:010
1140693994836,9cyclictest0-21swapper/023:00:000
1140693994836,9cyclictest0-21swapper/023:00:000
114069399483,42cyclictest0-21swapper/000:35:110
114069399483,42cyclictest0-21swapper/000:35:110
1140693994829,13cyclictest131ktimers/019:25:130
1140693994814,30cyclictest0-21swapper/022:15:270
114069799471,3cyclictest0-21swapper/223:20:172
1140695994739,5cyclictest1187066-21munin-plugin-st23:40:001
1140693994740,4cyclictest20650irq/252-8000000.ethernet19:50:150
1140693994740,4cyclictest167350irq/118-8000000.ethernet-tx020:05:020
1140693994740,4cyclictest167350irq/118-8000000.ethernet-tx000:25:170
1140693994731,14cyclictest167350irq/118-8000000.ethernet-tx021:05:220
1140693994724,20cyclictest20650irq/252-8000000.ethernet23:49:590
1140693994721,19cyclictest15-21rcuc/023:35:000
1140697994623,7cyclictest1142842-21/usr/sbin/munin19:20:172
1140695994639,5cyclictest1158876-21latency_hist20:55:001
1140695994632,9cyclictest1188025-21latency_hist23:45:011
1140695994632,9cyclictest0-21swapper/121:20:001
1140695994631,11cyclictest231ktimers/100:00:171
1140693994633,8cyclictest0-21swapper/020:15:290
1140697994532,10cyclictest0-21swapper/221:10:002
1140697994519,7cyclictest1176861-21cat22:40:002
1140697994513,4cyclictest1169146-21apt-get21:55:012
1140693994538,4cyclictest20650irq/252-8000000.ethernet22:30:270
1140693994535,8cyclictest1163156-21munin-plugin-st21:20:010
1140693994534,7cyclictest1150415-21apt-key20:05:000
114069399452,6cyclictest1172697-21latency_hist22:15:010
114069799447,13cyclictest0-21swapper/219:10:262
1140695994440,2cyclictest0-21swapper/119:50:021
1140693994436,4cyclictest20650irq/252-8000000.ethernet21:40:000
1140693994436,4cyclictest20650irq/252-8000000.ethernet21:40:000
1140693994436,4cyclictest20650irq/252-8000000.ethernet00:05:300
114069399441,37cyclictest0-21swapper/022:25:010
1140697994320,3cyclictest1164840-21cron21:30:002
1140697994316,7cyclictest311ktimers/222:40:162
1140697994316,7cyclictest311ktimers/222:40:162
1140695994335,4cyclictest0-21swapper/122:35:301
1140693994336,4cyclictest20650irq/252-8000000.ethernet22:05:230
114069399433,5cyclictest1155128-21meminfo20:30:230
1140693994333,4cyclictest1168239-21grep21:45:290
114069399432,6cyclictest1159431-21meminfo20:55:230
114069399432,6cyclictest1159431-21meminfo20:55:230
114069399432,5cyclictest1193742-21memory00:15:270
1140693994319,4cyclictest19750irq/27-20000000.i2c23:20:000
1140695994233,5cyclictest1157952-21grep20:45:291
1140695994232,7cyclictest0-21swapper/119:25:291
1140695994227,9cyclictest0-21swapper/123:00:301
1140695994215,13cyclictest231ktimers/100:15:131
114069399429,31cyclictest0-21swapper/021:20:110
1140693994235,4cyclictest20650irq/252-8000000.ethernet20:45:180
1140693994235,4cyclictest20650irq/252-8000000.ethernet19:20:000
1140693994235,4cyclictest20650irq/252-8000000.ethernet00:20:310
1140693994231,6cyclictest1184371-21grep23:20:290
1140693994224,15cyclictest0-21swapper/023:50:040
114069399422,29cyclictest12-21ksoftirqd/000:05:000
114069399421,4cyclictest0-21swapper/020:40:190
114069399421,4cyclictest0-21swapper/020:40:190
114069399420,3cyclictest1165184-21fschecks_time21:30:180
1140695994132,5cyclictest1142559-21grep19:15:291
1140695994128,8cyclictest1179310-21grep22:50:301
1140695994127,10cyclictest0-21swapper/123:00:011
1140695994127,10cyclictest0-21swapper/123:00:011
1140693994127,7cyclictest0-21swapper/019:20:280
114069399411,2cyclictest0-21swapper/020:20:190
1140695994032,4cyclictest0-21swapper/123:15:291
1140695994028,6cyclictest1196581-21grep00:30:281
1140695994026,8cyclictest0-21swapper/100:25:291
1140695994025,8cyclictest0-21swapper/122:00:291
114069599401,24cyclictest11453621/usr/sbin/munin19:35:221
1140695994012,15cyclictest231ktimers/123:50:171
1140693994034,3cyclictest20650irq/252-8000000.ethernet23:25:180
1140693994033,4cyclictest20650irq/252-8000000.ethernet20:10:110
114069399402,35cyclictest0-21swapper/020:25:260
1140693994018,19cyclictest1170022-21unixbench_singl21:55:300
114069399401,36cyclictest1168654-21lsblk21:50:190
114069399401,33cyclictest0-21swapper/000:15:020
114069399401,33cyclictest0-21swapper/000:15:010
114069799397,13cyclictest1181072-21grep23:05:002
1140695993931,4cyclictest1140689-21cyclictest00:25:001
1140695993930,5cyclictest0-21swapper/122:30:201
114069399394,7cyclictest1155836-21fschecks_time20:35:220
1140693993932,4cyclictest20650irq/252-8000000.ethernet19:45:110
1140693993932,4cyclictest20650irq/252-8000000.ethernet19:45:110
1140693993926,9cyclictest0-21swapper/023:45:010
114069399391,36cyclictest0-21swapper/021:40:190
114069399391,36cyclictest0-21swapper/021:40:190
114069399391,36cyclictest0-21swapper/021:25:270
1140693993912,3cyclictest0-21swapper/023:00:300
1140697993827,7cyclictest0-21swapper/220:10:272
1140693993829,6cyclictest1146803-21unixbench_singl19:40:280
114069399381,35cyclictest0-21swapper/023:55:130
1140697993724,9cyclictest0-21swapper/220:35:282
1140697993721,2cyclictest0-21swapper/222:05:282
1140697993719,11cyclictest0-21swapper/221:00:292
1140695993728,5cyclictest0-21swapper/121:00:271
1140695993727,6cyclictest0-21swapper/119:20:201
1140695993727,5cyclictest0-21swapper/120:10:261
1140695993725,8cyclictest0-21swapper/122:40:301
1140695993725,8cyclictest0-21swapper/122:40:301
1140695993725,7cyclictest0-21swapper/121:25:291
1140695993724,8cyclictest1184391-21grep23:20:291
114069399372,6cyclictest1177055-21apt-get22:40:140
114069399372,6cyclictest1177055-21apt-get22:40:140
1140693993717,18cyclictest0-21swapper/022:00:130
1140697993626,6cyclictest0-21swapper/200:25:292
1140695993630,3cyclictest1166547-21apt-get21:40:001
1140695993630,3cyclictest1166547-21apt-get21:40:001
1140695993623,9cyclictest0-21swapper/121:30:271
1140693993632,2cyclictest0-21swapper/000:30:280
1140693993627,6cyclictest1144821-21meminfo19:30:240
114069399361,27cyclictest1140750-21latency_hist19:10:010
1140697993527,4cyclictest0-21swapper/221:45:292
1140697993525,6cyclictest1181828-21grep23:05:292
1140695993527,5cyclictest0-21swapper/119:30:281
1140695993527,4cyclictest231ktimers/123:25:231
1140695993526,5cyclictest1171719-21head22:05:281
1140695993526,5cyclictest0-21swapper/121:55:001
1140695993525,6cyclictest1172556-21grep22:10:291
1140695993525,5cyclictest0-21swapper/100:10:311
1140695993525,5cyclictest0-21swapper/100:10:311
114069599351,28cyclictest1660-21snmpd21:10:281
114069599351,28cyclictest1660-21snmpd21:10:281
114069599351,27cyclictest1660-21snmpd20:30:191
114069599351,27cyclictest1153989-21/usr/sbin/munin20:25:291
1140695993425,5cyclictest0-21swapper/120:40:281
1140695993425,5cyclictest0-21swapper/120:40:281
1140695993425,5cyclictest0-21swapper/100:00:021
114069599341,2cyclictest0-21swapper/120:40:011
114069599341,27cyclictest1173673-21/usr/sbin/munin22:20:271
1140693993428,4cyclictest20850irq/208-8000000.ethernet22:36:490
1140693993421,8cyclictest1162081-21ptp4l21:10:270
1140693993421,8cyclictest1162081-21ptp4l21:10:270
1140697993322,5cyclictest0-21swapper/219:35:262
1140695993325,5cyclictest1161378-21grep21:05:291
1140695993320,8cyclictest231ktimers/123:05:181
1140695993316,12cyclictest0-21swapper/123:45:291
114069599331,26cyclictest1175138-21sshd22:27:491
114069599321,5cyclictest0-21swapper/120:20:021
114069599321,28cyclictest1660-21snmpd19:55:131
114069599321,28cyclictest1660-21snmpd19:55:131
1140695993212,11cyclictest231ktimers/121:45:121
1140697993121,6cyclictest0-21swapper/200:30:292
1140697993120,6cyclictest0-21swapper/223:10:282
1140697993120,6cyclictest0-21swapper/223:10:282
1140697993117,10cyclictest0-21swapper/220:40:272
1140697993117,10cyclictest0-21swapper/220:40:272
1140695993120,8cyclictest0-21swapper/120:10:011
1140697993021,5cyclictest0-21swapper/220:45:272
114069599303,24cyclictest1146848-21kthreadd19:44:231
1140695993023,5cyclictest1159130-21/usr/sbin/munin20:55:181
1140695993023,5cyclictest1159130-21/usr/sbin/munin20:55:181
1140697992920,6cyclictest0-21swapper/219:55:292
1140697992920,6cyclictest0-21swapper/219:55:292
1140697992917,8cyclictest0-21swapper/200:15:282
1140695992924,3cyclictest1153767-21kthreadd20:21:191
114069799284,16cyclictest1175880-21sed22:30:312
1140697992817,8cyclictest1660-21snmpd00:35:442
1140697992817,8cyclictest1660-21snmpd00:35:442
1140697992815,9cyclictest0-21swapper/223:19:592
1140695992819,6cyclictest0-21swapper/121:20:281
114069599281,2cyclictest0-21swapper/123:15:021
114069599281,2cyclictest0-21swapper/123:15:021
1140697992724,2cyclictest0-21swapper/222:55:272
1140697992724,2cyclictest0-21swapper/222:55:272
1140697992719,6cyclictest311ktimers/222:50:282
1140697992714,9cyclictest0-21swapper/219:30:282
1140697992617,4cyclictest0-21swapper/221:55:222
114069799261,2cyclictest0-21swapper/200:15:012
114069799261,2cyclictest0-21swapper/200:15:012
1140697992415,6cyclictest0-21swapper/222:10:262
1140695992417,5cyclictest0-21swapper/119:10:011
1140697992312,6cyclictest311ktimers/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional