You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 08:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Apr 22, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1370399250,1cyclictest31443-21ssh21:32:043
1370199250,2cyclictest32518-21sh21:33:512
13696992523,1cyclictest0-21swapper/100:10:441
1369699250,24cyclictest0-21swapper/122:30:461
1369699250,24cyclictest0-21swapper/121:44:311
1369699250,1cyclictest0-21swapper/122:20:241
13690992523,1cyclictest0-21swapper/023:41:170
1369099250,24cyclictest0-21swapper/023:55:180
1369099250,24cyclictest0-21swapper/022:00:560
1369099250,24cyclictest0-21swapper/021:17:160
13703992423,1cyclictest4842-21ssh23:12:573
13703992422,1cyclictest29606-21sh00:08:193
1370399240,1cyclictest17751-21sh21:19:293
1370399240,1cyclictest0-21swapper/321:55:503
1370399240,1cyclictest0-21swapper/321:55:503
1370199240,23cyclictest0-21swapper/221:57:122
1370199240,23cyclictest0-21swapper/221:57:122
1370199240,1cyclictest7723-21diskmemload22:58:322
1370199240,1cyclictest7131-21ssh22:11:012
13696992422,1cyclictest484-21hddtemp_smartct22:05:161
1369699240,24cyclictest0-21swapper/121:46:181
1369699240,23cyclictest7723-21diskmemload21:55:211
1369699240,23cyclictest7723-21diskmemload21:55:211
1369699240,23cyclictest7723-21diskmemload21:20:351
13690992421,3cyclictest28588-21apt-get21:30:140
1369099240,24cyclictest0-21swapper/022:44:060
1369099240,23cyclictest7723-21diskmemload23:33:450
1369099240,23cyclictest7723-21diskmemload21:13:560
1369099240,23cyclictest22829-21rm21:55:190
1369099240,23cyclictest22829-21rm21:55:190
1369099240,23cyclictest13420-21apt-get22:50:150
1369099240,23cyclictest0-21swapper/022:25:590
1369099240,23cyclictest0-21swapper/021:40:540
1369099240,23cyclictest0-21swapper/021:24:010
1369099240,23cyclictest0-21swapper/000:39:320
13703992323,0cyclictest0-21swapper/323:00:173
1370399230,2cyclictest15322-21sendmail-msp20:20:013
1370399230,23cyclictest0-21swapper/323:37:003
1370399230,23cyclictest0-21swapper/322:36:183
1370399230,23cyclictest0-21swapper/322:21:173
1370399230,22cyclictest4515-21sh21:37:443
1370399230,22cyclictest22447-21ssh22:25:493
1370399230,22cyclictest22128-21sh00:32:213
1370399230,22cyclictest16054-21munin-plugin-st19:15:003
1370399230,22cyclictest13546-21ssh22:18:063
1370399230,22cyclictest13021-21rm23:51:243
1370399230,0cyclictest7723-21diskmemload23:25:013
1370399230,0cyclictest7723-21diskmemload00:39:163
1370399230,0cyclictest0-21swapper/321:47:433
1370399230,0cyclictest0-21swapper/300:11:383
13701992323,0cyclictest7723-21diskmemload23:56:052
13701992323,0cyclictest0-21swapper/223:04:582
13701992323,0cyclictest0-21swapper/221:18:252
13701992322,0cyclictest0-21swapper/221:35:052
13701992321,1cyclictest11337-21sh22:47:222
13701992321,1cyclictest11337-21sh22:47:222
13701992320,2cyclictest23315-21munin-run19:30:012
13701992320,2cyclictest12925-21ssh23:51:152
13701992320,2cyclictest12868-21idleruntime-cro20:15:002
13701992319,4cyclictest0-21swapper/222:19:072
1370199230,2cyclictest29724-21ssh23:36:232
1370199230,23cyclictest0-21swapper/223:08:482
1370199230,22cyclictest7723-21diskmemload21:40:192
1370199230,22cyclictest7723-21diskmemload00:15:552
1370199230,22cyclictest3177-21apt-get21:00:022
1370199230,22cyclictest22093-21ls00:00:222
1370199230,22cyclictest20614-21ssh21:54:002
1370199230,22cyclictest16086-21ssh22:51:462
1370199230,1cyclictest23057-21ssh00:33:542
1370199230,0cyclictest7723-21diskmemload22:20:012
1370199230,0cyclictest2970-21ssh22:07:302
1370199230,0cyclictest0-21swapper/223:25:052
1370199230,0cyclictest0-21swapper/221:10:462
1370199230,0cyclictest0-21swapper/200:20:592
13696992323,0cyclictest7723-21diskmemload23:36:141
13696992323,0cyclictest7723-21diskmemload00:37:131
13696992323,0cyclictest0-21swapper/123:59:401
13696992323,0cyclictest0-21swapper/100:07:571
13696992321,1cyclictest7723-21diskmemload22:17:541
13696992321,1cyclictest13910-21sh23:21:161
13696992321,1cyclictest1206-21apt-get21:35:131
13696992320,2cyclictest20754-21ssh00:00:061
1369699230,23cyclictest0-21swapper/123:00:361
1369699230,23cyclictest0-21swapper/121:33:451
1369699230,23cyclictest0-21swapper/121:13:551
1369699230,22cyclictest8265-21sh23:46:581
1369699230,22cyclictest0-21swapper/123:30:151
1369699230,22cyclictest0-21swapper/123:27:321
1369699230,22cyclictest0-21swapper/122:35:141
1369699230,22cyclictest0-21swapper/121:50:141
1369699230,22cyclictest0-21swapper/100:31:171
1369699230,1cyclictest0-21swapper/100:20:211
1369699230,0cyclictest0-21swapper/123:51:361
1369699230,0cyclictest0-21swapper/121:26:021
13690992323,0cyclictest0-21swapper/023:53:150
13690992323,0cyclictest0-21swapper/023:28:250
13690992323,0cyclictest0-21swapper/022:13:020
13690992322,1cyclictest62550irq/127-eno123:13:400
1369099232,21cyclictest62550irq/127-eno122:36:170
13690992321,1cyclictest13941-21apt-get00:25:130
13690992321,1cyclictest0-21swapper/023:45:230
13690992321,1cyclictest0-21swapper/023:01:100
13690992321,1cyclictest0-21swapper/022:45:030
13690992321,1cyclictest0-21swapper/022:45:030
13690992321,1cyclictest0-21swapper/021:52:290
13690992321,1cyclictest0-21swapper/000:15:340
13690992320,2cyclictest3349-21ssh21:35:500
13690992320,2cyclictest27446-21sh22:30:450
1369099230,2cyclictest2563-21idleruntime-cro21:00:000
1369099230,23cyclictest0-21swapper/023:38:020
1369099230,23cyclictest0-21swapper/022:59:140
1369099230,22cyclictest7723-21diskmemload00:30:100
1369099230,22cyclictest1736-21sh00:12:230
1369099230,22cyclictest0-21swapper/023:18:010
1369099230,22cyclictest0-21swapper/022:07:540
1369099230,21cyclictest0-21swapper/000:04:490
1369099230,0cyclictest7723-21diskmemload23:09:200
1369099230,0cyclictest7723-21diskmemload00:09:260
1369099230,0cyclictest0-21swapper/022:16:050
13703992222,0cyclictest7723-21diskmemload23:45:443
13703992220,1cyclictest28766-21/usr/sbin/munin22:00:243
13703992220,1cyclictest0-21swapper/322:55:283
13703992220,1cyclictest0-21swapper/322:41:033
1370399220,22cyclictest0-21swapper/323:05:073
1370399220,21cyclictest8285-21/usr/sbin/munin22:45:143
1370399220,21cyclictest8285-21/usr/sbin/munin22:45:143
1370399220,21cyclictest7723-21diskmemload21:20:103
1370399220,21cyclictest5622-21apt-get21:05:153
1370399220,21cyclictest25675-21expr22:30:153
1370399220,21cyclictest21176-21apt-get19:25:133
1370399220,21cyclictest20903-21sh19:25:003
1370399220,21cyclictest18393-21diskmemload21:50:243
1370399220,21cyclictest0-21swapper/322:50:503
1370399220,21cyclictest0-21swapper/321:41:593
1370399220,21cyclictest0-21swapper/321:11:383
1370399220,21cyclictest0-21swapper/319:35:133
1370399220,1cyclictest4914-21ssh22:10:103
1370399220,1cyclictest26525-21sh21:27:283
1370399220,1cyclictest23458-21ssh00:01:323
1370399220,1cyclictest0-21swapper/323:44:113
1370399220,0cyclictest8782-21apt-get00:20:133
1370399220,0cyclictest2529-21apt-get21:00:023
1370399220,0cyclictest0-21swapper/323:15:453
13701992222,0cyclictest0-21swapper/223:41:232
13701992222,0cyclictest0-21swapper/223:30:222
13701992222,0cyclictest0-21swapper/223:15:222
13701992222,0cyclictest0-21swapper/222:37:472
13701992222,0cyclictest0-21swapper/221:20:202
13701992220,1cyclictest3521-21ssh23:10:492
13701992220,1cyclictest0-21swapper/200:09:332
1370199220,21cyclictest27516-21sh22:30:512
1370199220,21cyclictest25583-21ssh21:25:542
1370199220,21cyclictest20251-21rm22:25:102
1370199220,21cyclictest18033-21apt-get20:25:132
1370199220,1cyclictest7723-21diskmemload00:10:142
1370199220,1cyclictest30309-21ssh22:02:292
1370199220,1cyclictest14514-21ssh21:47:212
1370199220,1cyclictest13564-21ssh23:20:382
13696992222,0cyclictest7723-21diskmemload23:15:541
13696992222,0cyclictest7723-21diskmemload00:16:471
13696992222,0cyclictest0-21swapper/123:42:451
13696992222,0cyclictest0-21swapper/123:05:401
13696992222,0cyclictest0-21swapper/122:50:211
13696992220,1cyclictest0-21swapper/121:19:181
1369699220,22cyclictest0-21swapper/123:14:441
1369699220,21cyclictest0-21swapper/122:45:121
1369699220,21cyclictest0-21swapper/122:45:121
1369699220,21cyclictest0-21swapper/122:40:311
1369699220,21cyclictest0-21swapper/122:25:071
1369699220,21cyclictest0-21swapper/122:00:481
1369699220,21cyclictest0-21swapper/120:20:141
1369699220,21cyclictest0-21swapper/100:25:321
1369699220,1cyclictest20566-21ssh22:55:421
1369699220,1cyclictest0-21swapper/120:00:151
13690992221,1cyclictest12876-21awk20:15:000
13690992220,1cyclictest18517-21sendmail-msp19:20:000
13690992220,1cyclictest14070-21sh23:21:300
1369099220,21cyclictest8980-21ssh00:20:150
1369099220,21cyclictest7723-21diskmemload21:25:470
13703992121,0cyclictest0-21swapper/323:21:243
13703992120,1cyclictest18438-21ssh23:56:543
1370399210,21cyclictest0-21swapper/323:30:133
1370399210,21cyclictest0-21swapper/322:06:353
1370399210,21cyclictest0-21swapper/300:15:093
1370399210,20cyclictest7723-21diskmemload00:25:023
1370399210,20cyclictest23577-21apt-get19:30:143
13701992121,0cyclictest0-21swapper/219:35:132
13701992120,1cyclictest28785-21apt-get19:40:122
13701992119,1cyclictest5712-21grep20:00:002
1370199210,21cyclictest24068-21ssh00:35:102
1370199210,21cyclictest0-21swapper/222:40:182
1370199210,21cyclictest0-21swapper/220:02:412
1370199210,21cyclictest0-21swapper/219:15:002
1370199210,20cyclictest0-21swapper/220:05:132
1370199210,1cyclictest360-21apt-get20:55:132
13696992121,0cyclictest0-21swapper/122:10:121
1369699210,20cyclictest0-21swapper/120:45:141
1369699210,0cyclictest0-21swapper/119:35:021
13690992121,0cyclictest0-21swapper/019:25:130
13690992120,1cyclictest0-21swapper/020:15:130
1369099210,20cyclictest0-21swapper/019:50:130
1369099210,0cyclictest0-21swapper/021:05:150
1369099210,0cyclictest0-21swapper/021:00:140
13703992020,0cyclictest5979-21apt-get20:00:143
13703992020,0cyclictest0-21swapper/320:50:133
13703992020,0cyclictest0-21swapper/320:45:143
13703992019,1cyclictest31182-21apt-get19:45:133
13703992018,1cyclictest2543-21perf21:00:003
1370399200,0cyclictest0-21swapper/319:50:133
1370199200,19cyclictest18511-21latency_hist19:20:002
1370199200,0cyclictest30429-21apt-get20:50:142
13696992020,0cyclictest0-21swapper/119:30:131
13696992020,0cyclictest0-21swapper/119:25:131
13696992018,1cyclictest0-21swapper/120:50:141
1369699200,1cyclictest3561-21apt-get19:55:131
13690992020,0cyclictest0-21swapper/020:45:140
13690992020,0cyclictest0-21swapper/020:25:130
13690992019,1cyclictest0-21swapper/019:10:130
13690992018,1cyclictest62550irq/127-eno120:00:000
13703991919,0cyclictest0-21swapper/320:40:133
1370399190,19cyclictest0-21swapper/320:30:143
13701991919,0cyclictest20429-21apt-get20:30:142
13701991919,0cyclictest0-21swapper/220:45:142
13701991919,0cyclictest0-21swapper/220:35:132
13701991918,1cyclictest25593-21apt-get20:40:022
13701991918,1cyclictest1151-21apt-get19:50:132
13696991919,0cyclictest0-21swapper/120:35:131
13696991919,0cyclictest0-21swapper/120:10:131
13690991919,0cyclictest0-21swapper/020:00:140
13690991919,0cyclictest0-21swapper/019:35:020
13690991918,1cyclictest20429-21apt-get20:30:140
13701991818,0cyclictest0-21swapper/219:20:122
13696991818,0cyclictest18781-21apt-get19:20:121
13696991818,0cyclictest16309-21apt-get19:15:121
13696991818,0cyclictest0-21swapper/121:00:251
13696991816,1cyclictest619-21polkitd20:10:001
13690991818,0cyclictest0-21swapper/020:40:130
13690991818,0cyclictest0-21swapper/019:30:140
13703991714,2cyclictest12887-21sh20:15:003
13701991717,0cyclictest0-21swapper/220:20:142
1370199170,16cyclictest31605-21diskstats19:45:142
1370199170,0cyclictest0-21swapper/219:30:132
13696991717,0cyclictest0-21swapper/120:35:011
13696991714,2cyclictest3282-21awk19:55:001
13690991717,0cyclictest0-21swapper/020:50:140
1369099170,0cyclictest15586-21apt-get20:20:140
1370399160,14cyclictest0-21swapper/320:25:013
1370399160,0cyclictest0-21swapper/320:05:133
1369699160,15cyclictest0-21swapper/119:10:141
13690991616,0cyclictest0-21swapper/019:45:130
13690991614,1cyclictest24973-21apt-get20:40:010
13703991513,1cyclictest5680-21idleruntime-cro20:00:003
13696991513,1cyclictest0-21swapper/119:45:141
1369699150,1cyclictest20156-21idleruntime-cro20:30:011
13703991414,0cyclictest0-21swapper/319:16:383
13703991412,1cyclictest0-21swapper/320:25:133
1370399140,14cyclictest0-21swapper/320:35:053
1370399140,14cyclictest0-21swapper/319:40:373
1370199140,14cyclictest0-21swapper/220:16:412
1370199140,0cyclictest0-21swapper/221:05:162
13696991414,0cyclictest0-21swapper/120:55:131
1369699140,0cyclictest0-21swapper/120:16:271
1369099140,14cyclictest0-21swapper/020:05:220
1369099140,14cyclictest0-21swapper/019:40:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional