You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 10:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Mon Jan 05, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
142897399904,43cyclictest1454169-21/usr/sbin/munin21:35:211
142897399893,75cyclictest1483163-21/usr/sbin/munin00:25:201
1428976998613,58cyclictest38-21rcuc/300:20:203
142897099801,70cyclictest1444692-21wc20:40:010
142897399771,49cyclictest0-21swapper/100:40:011
1428974997611,59cyclictest32-21ksoftirqd/223:25:212
142897099752,3cyclictest1443910-21latency_hist20:35:010
142897099742,3cyclictest1438410-21wc20:00:290
142897099723,4cyclictest1432721-21grep19:30:000
142897099721,65cyclictest0-21swapper/022:40:300
1428970997037,28cyclictest167350irq/118-8000000.ethernet-tx021:50:190
142897099703,2cyclictest0-21swapper/000:05:010
142897099701,62cyclictest1482104-21latency_hist00:20:010
142897399691,54cyclictest0-21swapper/121:50:161
142897399691,52cyclictest0-21swapper/121:20:151
142897099691,65cyclictest1466998-21df_inode22:50:170
1428973996828,34cyclictest0-21swapper/123:25:311
1428973996826,33cyclictest0-21swapper/123:10:331
142897399681,52cyclictest0-21swapper/100:15:151
142897399681,51cyclictest0-21swapper/122:55:101
142897099671,64cyclictest0-21swapper/021:35:300
142897099671,63cyclictest0-21swapper/000:30:000
1428974996639,21cyclictest30-21rcuc/221:20:212
1428973996621,41cyclictest1660-21snmpd21:25:401
142897399661,52cyclictest0-21swapper/120:20:161
142897399651,50cyclictest0-21swapper/122:35:161
1428973996420,35cyclictest0-21swapper/119:40:011
142897399641,48cyclictest0-21swapper/100:30:161
1428970996427,33cyclictest0-21swapper/020:55:300
142897099642,5cyclictest1480328-21apt-get00:10:010
142897099642,5cyclictest1445062-21/usr/sbin/munin20:40:240
1428973996320,37cyclictest0-21swapper/120:00:221
142897399631,49cyclictest0-21swapper/121:15:141
142897399631,49cyclictest0-21swapper/120:40:141
142897399631,48cyclictest0-21swapper/121:00:151
142897399631,48cyclictest0-21swapper/119:30:131
142897099631,60cyclictest1478066-21/usr/sbin/munin23:55:190
142897099631,60cyclictest1478066-21/usr/sbin/munin23:55:190
142897099631,60cyclictest0-21swapper/023:25:220
142897099631,60cyclictest0-21swapper/022:20:220
142897099631,60cyclictest0-21swapper/020:15:310
142897099631,4cyclictest1463850-21load22:30:240
142897099631,24cyclictest1470607-21/usr/sbin/munin23:10:280
142897399621,49cyclictest0-21swapper/123:30:121
142897399621,48cyclictest0-21swapper/123:45:151
142897399621,48cyclictest0-21swapper/122:20:121
142897399621,47cyclictest0-21swapper/122:30:131
142897099623,52cyclictest1460769-21grep22:10:300
142897099621,55cyclictest0-21swapper/020:55:010
142897099621,55cyclictest0-21swapper/019:50:000
142897099621,3cyclictest1442295-21tune2fs20:25:200
142897399611,46cyclictest0-21swapper/123:20:121
142897099613,3cyclictest1464550-21cut22:35:210
142897099612,3cyclictest1458286-21date22:00:020
1428973996021,30cyclictest0-21swapper/122:10:301
1428973996016,35cyclictest0-21swapper/123:15:281
142897399601,51cyclictest1442181-21apt-get20:25:161
142897399601,45cyclictest0-21swapper/123:00:121
142897399601,45cyclictest0-21swapper/121:10:121
142897399601,45cyclictest0-21swapper/121:10:121
142897099604,8cyclictest1446181-21grep20:45:260
142897099603,5cyclictest1430175-21meminfo19:15:040
1428970996034,21cyclictest1475088-21grep23:35:280
142897099602,4cyclictest1477414-21irqstats23:50:250
142897499597,27cyclictest32-21ksoftirqd/222:40:012
142897399591,49cyclictest0-21swapper/120:45:131
142897399591,48cyclictest0-21swapper/120:05:141
142897399591,44cyclictest0-21swapper/119:40:151
1428970995929,25cyclictest0-21swapper/021:25:280
142897099591,56cyclictest0-21swapper/019:40:000
142897099591,55cyclictest0-21swapper/023:05:280
142897099591,52cyclictest1435392-21ls19:45:000
142897099591,52cyclictest0-21swapper/020:15:020
1428973995828,22cyclictest0-21swapper/120:55:211
1428973995820,31cyclictest0-21swapper/123:40:261
142897399581,43cyclictest0-21swapper/100:20:151
142897099581,55cyclictest0-21swapper/019:50:260
142897099581,54cyclictest0-21swapper/021:00:330
142897099581,53cyclictest1474130-21grep23:30:260
142897099581,51cyclictest0-21swapper/019:25:010
142897099581,3cyclictest1441639-21memory20:20:260
142897399571,48cyclictest1432029-21/usr/sbin/munin19:25:211
142897399571,47cyclictest1479693-21apt-get00:05:141
142897399571,44cyclictest0-21swapper/121:30:141
1428970995726,28cyclictest20850irq/208-8000000.ethernet00:20:120
142897099571,54cyclictest1456016-21tune2fs21:45:200
142897099571,52cyclictest1439340-21sed20:05:290
142897399562,46cyclictest1462718-21apt-get22:25:131
142897399561,47cyclictest1446811-21/usr/sbin/munin20:50:271
142897399561,47cyclictest1429487-21/usr/sbin/munin19:10:251
142897399561,46cyclictest0-21swapper/122:40:151
142897399561,45cyclictest1466934-21apt-get22:50:121
142897399561,43cyclictest0-21swapper/100:00:161
142897099562,5cyclictest1429793-21munin-node19:15:010
142897099561,3cyclictest1468689-21df23:00:180
142897399552,45cyclictest1469472-21apt-get23:05:171
142897399552,44cyclictest1431121-21apt-get19:20:161
142897399551,47cyclictest1466314-21/usr/sbin/munin22:45:231
142897399551,47cyclictest1466314-21/usr/sbin/munin22:45:231
142897399551,45cyclictest1444195-21/usr/sbin/munin20:35:221
142897399551,45cyclictest1440738-21/usr/sbin/munin20:15:261
1428970995547,4cyclictest0-21swapper/023:15:110
1428970995532,19cyclictest167350irq/118-8000000.ethernet-tx021:15:010
1428970995532,19cyclictest167350irq/118-8000000.ethernet-tx021:15:000
142897099552,50cyclictest1452128-21mailstats21:20:290
142897099551,52cyclictest0-21swapper/019:30:290
142897099551,52cyclictest0-21swapper/000:10:240
142897099551,51cyclictest1484561-21awk00:30:300
142897099551,49cyclictest0-21swapper/023:50:010
1428970995513,7cyclictest0-21swapper/021:05:270
142897399543,41cyclictest1443104-21munin-node20:30:121
142897399542,44cyclictest1456164-21/usr/sbin/munin21:45:241
142897399542,44cyclictest1437663-21/usr/sbin/munin19:55:301
1428973995419,28cyclictest0-21swapper/121:40:301
142897399541,46cyclictest1436569-21/usr/sbin/munin19:50:311
142897399541,46cyclictest0-21swapper/120:10:131
142897399541,45cyclictest1478048-21/usr/sbin/munin23:55:161
142897399541,45cyclictest1478048-21/usr/sbin/munin23:55:161
142897399541,45cyclictest1474779-21/usr/sbin/munin23:35:231
142897399541,45cyclictest1449421-21/usr/sbin/munin21:05:311
142897399541,45cyclictest1430619-21/usr/sbin/munin19:15:281
142897099544,11cyclictest1458983-21grep22:00:300
1428970995419,5cyclictest1427001-1kworker/0:0H+mmc_complete22:10:020
142897099541,4cyclictest1455736-21sed21:45:010
142897099541,3cyclictest1467827-21df22:55:150
142897499533,21cyclictest32-21ksoftirqd/200:00:012
142897499533,21cyclictest32-21ksoftirqd/200:00:012
142897399531,45cyclictest1480920-21memory00:10:241
142897399531,45cyclictest0-21swapper/121:55:141
142897399531,44cyclictest1461449-21/usr/sbin/munin22:15:281
1428970995324,4cyclictest0-21swapper/021:15:240
142897099531,50cyclictest0-21swapper/023:40:210
142897099531,50cyclictest0-21swapper/022:15:250
142897099531,3cyclictest1437520-21sshd19:55:290
142897399522,43cyclictest1435490-21/usr/sbin/munin19:45:161
142897399521,44cyclictest1459245-21/usr/sbin/munin22:05:101
142897399521,43cyclictest1477156-21apt-get23:50:131
142897399521,43cyclictest1458404-21munin-node22:00:111
142897099521,4cyclictest0-21swapper/023:25:000
142897099521,3cyclictest0-21swapper/021:30:300
1428970995112,9cyclictest0-21swapper/022:25:290
1428974995019,19cyclictest30-21rcuc/200:20:022
142897099501,24cyclictest0-21swapper/000:35:440
1428974994833,10cyclictest0-21swapper/200:10:002
1428974994738,6cyclictest1442988-21latency_hist20:30:012
1428974994737,7cyclictest1437753-21sendmail20:00:002
1428974994725,16cyclictest311ktimers/222:50:142
142897099461,42cyclictest1466462-21ps22:45:280
142897099461,42cyclictest1466462-21ps22:45:280
142897099441,23cyclictest0-21swapper/019:10:020
1428974994330,7cyclictest0-21swapper/221:25:292
1428974994224,9cyclictest311ktimers/222:20:152
1428974994223,11cyclictest1660-21snmpd23:30:232
1428974994122,10cyclictest0-21swapper/221:15:272
142897399411,32cyclictest1429082-21latency_hist19:10:011
142897499409,21cyclictest30-21rcuc/219:50:012
1428974994023,8cyclictest311ktimers/221:55:222
1428974994022,14cyclictest311ktimers/220:15:142
1428974994021,10cyclictest0-21swapper/221:05:322
1428974993925,8cyclictest0-21swapper/221:50:302
1428974993922,8cyclictest0-21swapper/222:30:302
1428974993921,7cyclictest311ktimers/220:00:122
1428974993920,11cyclictest311ktimers/223:50:282
1428974993830,4cyclictest311ktimers/220:10:212
1428974993829,6cyclictest1484602-21grep00:30:312
1428974993828,5cyclictest167550irq/134-8000000.ethernet-tx219:40:292
1428974993827,8cyclictest311ktimers/220:50:142
1428974993825,9cyclictest311ktimers/223:45:112
1428974993825,8cyclictest0-21swapper/220:45:172
1428974993824,9cyclictest0-21swapper/223:15:212
1428974993728,6cyclictest0-21swapper/223:35:292
1428974993728,5cyclictest311ktimers/223:10:272
1428974993727,4cyclictest311ktimers/220:30:302
1428974993726,7cyclictest0-21swapper/200:00:312
1428974993725,7cyclictest311ktimers/221:10:152
1428974993725,7cyclictest311ktimers/221:10:152
1428974993724,9cyclictest0-21swapper/220:05:262
1428974993724,6cyclictest0-21swapper/219:30:212
1428974993720,9cyclictest30-21rcuc/219:40:022
142897499367,24cyclictest30-21rcuc/200:10:192
1428974993625,7cyclictest311ktimers/219:15:212
1428974993625,7cyclictest0-21swapper/220:40:022
1428974993625,5cyclictest0-21swapper/219:20:222
1428974993624,7cyclictest311ktimers/221:45:202
1428974993624,6cyclictest30-21rcuc/222:15:302
1428974993623,8cyclictest0-21swapper/219:50:252
1428974993528,5cyclictest51-21kcompactd022:45:192
1428974993528,5cyclictest51-21kcompactd022:45:192
1428974993526,6cyclictest1447325-21/usr/sbin/munin20:55:202
1428974993427,4cyclictest311ktimers/200:25:162
1428974993424,5cyclictest311ktimers/222:00:202
1428974993424,5cyclictest0-21swapper/222:10:002
1428974993423,7cyclictest0-21swapper/221:35:312
1428974993329,2cyclictest0-21swapper/200:35:322
1428974993325,5cyclictest14-21rcu_preempt19:25:302
1428974993325,4cyclictest311ktimers/200:25:012
1428974993325,3cyclictest0-21swapper/220:40:282
1428974993321,7cyclictest311ktimers/221:00:152
1428974993320,8cyclictest311ktimers/223:10:002
1428974993224,5cyclictest0-21swapper/220:20:302
1428974993224,4cyclictest311ktimers/221:30:282
1428974993224,4cyclictest0-21swapper/219:10:282
1428974993223,7cyclictest311ktimers/223:00:112
1428974993223,5cyclictest30-21rcuc/222:40:282
142897499312,26cyclictest1472091-21/usr/sbin/munin23:20:212
1428974993023,5cyclictest311ktimers/222:10:192
1428974993023,4cyclictest311ktimers/221:41:282
1428974993023,4cyclictest14-21rcu_preempt23:40:302
1428974993020,7cyclictest30-21rcuc/222:25:312
1428974992922,4cyclictest30-21rcuc/222:55:252
1428974992916,6cyclictest30-21rcuc/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional