You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 03:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Mon Jun 22, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9260352243170,22sleep00-21swapper/019:09:100
9258122239167,23sleep20-21swapper/219:05:592
9260202225194,20sleep30-21swapper/319:08:583
9259492225163,50sleep60-21swapper/619:07:556
9258792225191,22sleep10-21swapper/119:06:541
9258172220187,22sleep70-21swapper/719:06:037
9260122219186,21sleep40-21swapper/419:08:504
9258922210173,26sleep50-21swapper/519:07:065
926306992622,3cyclictest1003696-21cron21:20:003
92631499250,24cyclictest935885-21appstreamcli19:25:037
92631299250,3cyclictest1015537-21sendmail21:40:006
92631299250,24cyclictest950622-21munin-plugin-st19:50:006
92631199250,24cyclictest0-21swapper/521:50:145
92631199250,24cyclictest0-21swapper/520:00:125
92630799250,24cyclictest965375-21perf-exec20:15:004
92630699250,24cyclictest1068658-21munin-run23:10:013
92630199250,24cyclictest0-21swapper/221:50:142
92630099250,24cyclictest0-21swapper/119:15:131
926296992521,3cyclictest950614-21turbostat19:50:000
92629699250,24cyclictest1110033-21awk00:20:000
92631499240,24cyclictest1117638-21awk00:30:197
92631499240,1cyclictest0-21swapper/723:55:007
926307992420,2cyclictest1030232-21cron22:05:004
92630699240,23cyclictest0-21swapper/323:50:113
92630699240,23cyclictest0-21swapper/323:45:133
92630699240,23cyclictest0-21swapper/321:45:123
926301992421,3cyclictest0-21swapper/222:30:122
92630199240,3cyclictest1107059-21awk00:15:002
92630199240,3cyclictest1107059-21awk00:15:002
92630099240,23cyclictest0-21swapper/100:30:191
92630099240,22cyclictest0-21swapper/122:19:591
926296992422,1cyclictest0-21swapper/022:35:140
92629699240,3cyclictest946451-21ntpq19:40:180
92629699240,3cyclictest1062741-21sh23:00:000
92631499230,22cyclictest0-21swapper/721:15:147
92631499230,22cyclictest0-21swapper/719:40:127
92631499230,0cyclictest0-21swapper/722:45:127
926312992322,1cyclictest0-21swapper/600:20:186
926312992321,1cyclictest965785-21apt-get20:15:126
926312992321,1cyclictest965785-21apt-get20:15:116
926312992321,1cyclictest1007096-21apt-get21:25:126
92631299230,22cyclictest1077934-21apt-get23:25:116
92631299230,22cyclictest1072020-21apt-get23:15:116
92631299230,22cyclictest1003715-21munin-run21:20:016
92631299230,22cyclictest0-21swapper/623:35:126
92631299230,22cyclictest0-21swapper/622:35:146
92631299230,22cyclictest0-21swapper/620:25:146
926311992321,1cyclictest1030681-21apt-get22:05:125
92631199230,22cyclictest1095214-21apt-get23:55:035
92631199230,22cyclictest0-21swapper/520:55:035
926307992321,1cyclictest1116330-21apt-get00:30:124
926307992318,4cyclictest1068667-21awk23:10:014
92630799230,22cyclictest1061556-21ntpq22:55:194
92630799230,22cyclictest1003731-21idleruntime-cro21:20:004
92630799230,22cyclictest0-21swapper/423:30:194
92630799230,22cyclictest0-21swapper/420:15:124
92630799230,22cyclictest0-21swapper/420:15:114
92630799230,0cyclictest0-21swapper/400:20:174
92630699230,22cyclictest1095287-21appstreamcli23:55:023
92630699230,22cyclictest0-21swapper/323:35:133
92630699230,22cyclictest0-21swapper/320:55:013
92630699230,22cyclictest0-21swapper/320:05:203
92630699230,22cyclictest0-21swapper/300:20:113
92630699230,1cyclictest1088162-21ntpq23:40:193
926301992323,0cyclictest0-21swapper/223:55:192
926301992321,1cyclictest0-21swapper/222:35:122
926301992320,2cyclictest951046-21apt-get19:50:142
92630199230,22cyclictest0-21swapper/223:15:122
92630199230,22cyclictest0-21swapper/220:55:022
92630099230,22cyclictest968353-21basename20:20:001
92630099230,22cyclictest968353-21basename20:20:001
92630099230,22cyclictest1083860-21apt-get23:35:131
92630099230,22cyclictest0-21swapper/123:20:131
92630099230,22cyclictest0-21swapper/123:05:171
92630099230,22cyclictest0-21swapper/120:40:011
92629699230,23cyclictest1083390-21apt-get23:35:030
926314992222,0cyclictest0-21swapper/723:40:127
926314992222,0cyclictest0-21swapper/700:05:227
926314992222,0cyclictest0-21swapper/700:05:217
926314992221,1cyclictest968752-21apt-get20:20:127
926314992221,1cyclictest1060238-21apt-get22:55:127
926314992221,1cyclictest0-21swapper/721:30:127
926314992221,1cyclictest0-21swapper/721:00:117
92631499220,22cyclictest935820-21awk19:25:017
92631499220,22cyclictest1069081-21apt-get23:10:117
92631499220,22cyclictest0-21swapper/720:50:127
92631499220,21cyclictest0-21swapper/723:05:127
92631499220,21cyclictest0-21swapper/720:55:117
92631499220,21cyclictest0-21swapper/719:45:137
92631499220,1cyclictest1004158-21apt-get21:20:157
92631499220,1cyclictest0-21swapper/722:20:117
92631499220,1cyclictest0-21swapper/719:20:017
926312992221,1cyclictest0-21swapper/622:45:136
926312992221,1cyclictest0-21swapper/620:55:016
926312992221,1cyclictest0-21swapper/620:05:126
926312992220,1cyclictest0-21swapper/622:14:596
92631299220,21cyclictest0-21swapper/623:45:126
92631299220,21cyclictest0-21swapper/621:05:136
92631299220,21cyclictest0-21swapper/619:25:126
92631299220,21cyclictest0-21swapper/600:15:106
92631299220,21cyclictest0-21swapper/600:05:236
92631299220,21cyclictest0-21swapper/600:05:236
92631299220,1cyclictest1057300-21apt-get22:50:136
926311992221,1cyclictest1024766-21apt-get21:55:115
926311992220,1cyclictest0-21swapper/523:25:125
926311992220,1cyclictest0-21swapper/521:00:115
926311992220,1cyclictest0-21swapper/520:40:115
92631199220,22cyclictest1033620-21apt-get22:10:115
92631199220,21cyclictest926636-21apt-get19:10:185
92631199220,21cyclictest1054359-21apt-get22:45:125
92631199220,21cyclictest0-21swapper/520:50:125
92631199220,21cyclictest0-21swapper/520:30:145
92631199220,21cyclictest0-21swapper/519:20:135
926307992221,1cyclictest1101594-21apt-get00:05:144
926307992221,1cyclictest1101594-21apt-get00:05:144
926307992221,1cyclictest0-21swapper/419:20:124
926307992221,1cyclictest0-21swapper/400:25:204
92630799220,22cyclictest986002-21munin-run20:50:004
92630799220,22cyclictest1088128-21ntpq23:40:194
92630799220,21cyclictest0-21swapper/421:55:114
92630799220,21cyclictest0-21swapper/421:30:124
92630799220,21cyclictest0-21swapper/419:55:134
92630799220,21cyclictest0-21swapper/419:40:134
92630799220,21cyclictest0-21swapper/400:10:134
92630799220,21cyclictest0-21swapper/400:10:134
92630799220,1cyclictest0-21swapper/400:15:174
926306992221,1cyclictest989404-21apt-get20:55:123
926306992221,1cyclictest953988-21apt-get19:55:123
926306992221,1cyclictest1098651-21apt-get00:00:113
926306992221,1cyclictest1061538-21ntpq22:55:193
926306992221,1cyclictest1039528-21apt-get22:20:123
926306992221,1cyclictest1010039-21apt-get21:30:123
926306992221,1cyclictest0-21swapper/319:45:043
926306992221,1cyclictest0-21swapper/300:30:123
926306992220,1cyclictest0-21swapper/322:35:133
926306992220,1cyclictest0-21swapper/320:45:093
92630699220,22cyclictest0-21swapper/323:20:123
92630699220,21cyclictest0-21swapper/322:00:183
92630699220,21cyclictest0-21swapper/321:40:013
92630699220,21cyclictest0-21swapper/320:30:143
92630699220,21cyclictest0-21swapper/300:35:113
92630699220,21cyclictest0-21swapper/300:10:133
92630699220,21cyclictest0-21swapper/300:10:123
92630699220,1cyclictest0-21swapper/321:20:143
92630699220,1cyclictest0-21swapper/320:20:123
92630699220,0cyclictest0-21swapper/323:00:143
926301992222,0cyclictest0-21swapper/220:50:122
926301992221,1cyclictest0-21swapper/219:30:112
926301992220,1cyclictest1089339-21awk23:45:002
926301992220,1cyclictest0-21swapper/200:35:112
926301992219,2cyclictest789-21dbus-daemon19:45:002
92630199220,22cyclictest962422-21munin-run20:10:002
92630199220,22cyclictest0-21swapper/219:20:132
92630199220,21cyclictest0-21swapper/223:10:192
92630199220,21cyclictest0-21swapper/222:10:112
92630199220,21cyclictest0-21swapper/221:25:122
92630199220,21cyclictest0-21swapper/221:10:132
92630199220,21cyclictest0-21swapper/219:15:122
92630199220,1cyclictest0-21swapper/219:35:132
92630199220,0cyclictest0-21swapper/221:35:142
92630199220,0cyclictest0-21swapper/219:10:192
926300992221,1cyclictest991-21snmpd23:00:131
926300992221,1cyclictest980540-21apt-get20:40:111
92630099220,22cyclictest1071598-21munin-run23:15:011
92630099220,22cyclictest0-21swapper/120:30:141
92630099220,22cyclictest0-21swapper/120:20:121
92630099220,22cyclictest0-21swapper/119:30:111
92630099220,22cyclictest0-21swapper/100:15:101
92630099220,21cyclictest995307-21apt-get21:05:131
92630099220,21cyclictest0-21swapper/123:55:041
92630099220,21cyclictest0-21swapper/123:50:131
92630099220,21cyclictest0-21swapper/122:40:121
92630099220,21cyclictest0-21swapper/121:10:131
92630099220,21cyclictest0-21swapper/120:25:141
92630099220,21cyclictest0-21swapper/120:00:121
92630099220,21cyclictest0-21swapper/100:35:111
92630099220,1cyclictest0-21swapper/121:55:111
92630099220,0cyclictest0-21swapper/119:45:031
926296992221,1cyclictest1027740-21apt-get22:00:120
926296992221,1cyclictest0-21swapper/021:05:130
926296992221,1cyclictest0-21swapper/020:55:120
926296992220,1cyclictest1088103-21awk23:40:170
926296992220,1cyclictest0-21swapper/000:10:010
926296992220,1cyclictest0-21swapper/000:10:000
926296992217,4cyclictest1068654-21grep23:10:000
92629699220,22cyclictest0-21swapper/021:20:150
92629699220,21cyclictest0-21swapper/023:55:000
92629699220,21cyclictest0-21swapper/023:45:120
92629699220,21cyclictest0-21swapper/023:30:120
92629699220,21cyclictest0-21swapper/022:50:130
92629699220,1cyclictest977578-21apt-get20:35:110
92629699220,1cyclictest0-21swapper/022:15:130
926314992121,0cyclictest0-21swapper/723:35:187
926314992121,0cyclictest0-21swapper/723:15:117
926314992121,0cyclictest0-21swapper/720:25:147
926314992121,0cyclictest0-21swapper/720:05:137
926314992121,0cyclictest0-21swapper/719:30:117
926314992120,1cyclictest1099988-21awk00:00:227
926314992119,1cyclictest998245-21apt-get21:10:117
926314992116,4cyclictest1110037-21tr00:20:007
92631499210,21cyclictest0-21swapper/721:55:127
92631499210,21cyclictest0-21swapper/720:35:117
92631499210,20cyclictest0-21swapper/723:00:137
92631499210,1cyclictest962845-21apt-get20:10:137
92631499210,1cyclictest1029058-21ntpq22:00:187
92631499210,0cyclictest0-21swapper/722:40:137
92631499210,0cyclictest0-21swapper/720:45:107
92631499210,0cyclictest0-21swapper/700:25:137
926312992121,0cyclictest0-21swapper/622:30:126
926312992120,1cyclictest974638-21apt-get20:30:146
926312992120,1cyclictest930331-21apt-get19:15:126
926312992120,1cyclictest0-21swapper/623:10:116
926312992119,1cyclictest939218-21apt-get19:30:126
926312992119,1cyclictest0-21swapper/623:55:026
926312992119,1cyclictest0-21swapper/622:55:126
926312992119,1cyclictest0-21swapper/622:40:136
92631299210,20cyclictest0-21swapper/620:35:106
92631299210,20cyclictest0-21swapper/619:40:126
92631299210,20cyclictest0-21swapper/619:25:006
92631299210,1cyclictest0-21swapper/620:55:036
92631299210,1cyclictest0-21swapper/620:10:196
92631299210,0cyclictest0-21swapper/623:55:006
92631299210,0cyclictest0-21swapper/622:00:136
92631299210,0cyclictest0-21swapper/621:10:126
92631299210,0cyclictest0-21swapper/621:00:116
92631199214,4cyclictest0-21swapper/522:51:485
926311992121,0cyclictest0-21swapper/519:30:125
926311992120,1cyclictest1089343-21perf23:45:005
926311992120,1cyclictest0-21swapper/522:15:135
926311992120,1cyclictest0-21swapper/519:50:135
926311992120,1cyclictest0-21swapper/500:30:115
926311992119,1cyclictest929992-21ntp_states19:15:015
92631199210,21cyclictest0-21swapper/520:05:125
92631199210,21cyclictest0-21swapper/519:25:125
92631199210,21cyclictest0-21swapper/500:25:205
92631199210,20cyclictest0-21swapper/500:15:105
92631199210,0cyclictest0-21swapper/523:15:115
92631199210,0cyclictest0-21swapper/521:35:135
92631199210,0cyclictest0-21swapper/521:25:135
92631199210,0cyclictest0-21swapper/521:20:145
92631199210,0cyclictest0-21swapper/521:10:125
926307992121,0cyclictest0-21swapper/423:25:124
926307992121,0cyclictest0-21swapper/423:15:114
926307992121,0cyclictest0-21swapper/423:00:144
926307992121,0cyclictest0-21swapper/421:20:144
926307992121,0cyclictest0-21swapper/419:25:124
926307992120,1cyclictest1050984-21perf22:39:594
926307992120,1cyclictest1018885-21apt-get21:45:114
926307992120,1cyclictest0-21swapper/420:35:104
926307992120,1cyclictest0-21swapper/419:35:004
92630799210,21cyclictest1119270-21apt-get00:35:114
92630799210,21cyclictest1058575-21ntpq22:50:194
92630799210,21cyclictest0-21swapper/400:00:214
92630799210,20cyclictest0-21swapper/422:30:124
92630799210,20cyclictest0-21swapper/422:20:124
92630799210,20cyclictest0-21swapper/420:05:124
92630799210,20cyclictest0-21swapper/420:00:114
92630799210,0cyclictest0-21swapper/422:05:124
92630799210,0cyclictest0-21swapper/420:55:134
92630799210,0cyclictest0-21swapper/420:25:144
926306992121,0cyclictest0-21swapper/322:10:123
926306992121,0cyclictest0-21swapper/300:05:143
926306992121,0cyclictest0-21swapper/300:05:143
926306992120,1cyclictest945125-21apt-get19:40:123
926306992120,1cyclictest1021828-21apt-get21:50:133
926306992120,1cyclictest0-21swapper/323:30:183
926306992120,1cyclictest0-21swapper/322:50:133
926306992120,1cyclictest0-21swapper/322:29:593
926306992120,1cyclictest0-21swapper/322:05:193
926306992120,1cyclictest0-21swapper/321:00:123
926306992120,1cyclictest0-21swapper/320:10:123
92630699210,21cyclictest0-21swapper/322:50:003
92630699210,20cyclictest0-21swapper/300:15:123
92630699210,0cyclictest0-21swapper/322:40:113
92630699210,0cyclictest0-21swapper/321:05:143
92630699210,0cyclictest0-21swapper/320:40:113
92630699210,0cyclictest0-21swapper/320:25:213
926301992121,0cyclictest0-21swapper/222:25:122
926301992121,0cyclictest0-21swapper/222:05:112
926301992121,0cyclictest0-21swapper/221:55:112
926301992120,1cyclictest1051417-21apt-get22:40:122
926301992120,1cyclictest0-21swapper/223:25:112
926301992120,1cyclictest0-21swapper/220:30:142
926301992119,1cyclictest0-21swapper/222:55:192
926301992119,1cyclictest0-21swapper/220:15:112
926301992119,1cyclictest0-21swapper/220:15:112
926301992119,1cyclictest0-21swapper/220:00:122
926301992119,1cyclictest0-21swapper/200:25:122
926301992117,3cyclictest1089764-21apt-get23:45:132
92630199210,21cyclictest0-21swapper/222:45:112
92630199210,1cyclictest937600-21ntpq19:25:182
92630199210,0cyclictest0-21swapper/222:00:122
92630199210,0cyclictest0-21swapper/221:20:142
926300992121,0cyclictest0-21swapper/122:55:121
926300992121,0cyclictest0-21swapper/122:50:121
926300992120,1cyclictest0-21swapper/122:35:131
926300992120,1cyclictest0-21swapper/120:45:091
926300992119,1cyclictest0-21swapper/122:30:031
92630099210,21cyclictest0-21swapper/119:25:121
92630099210,20cyclictest0-21swapper/120:05:121
92630099210,1cyclictest0-21swapper/123:45:121
92630099210,0cyclictest0-21swapper/121:50:211
92630099210,0cyclictest0-21swapper/121:40:191
926296992121,0cyclictest0-21swapper/023:25:110
926296992121,0cyclictest0-21swapper/023:10:120
926296992121,0cyclictest0-21swapper/021:15:140
926296992121,0cyclictest0-21swapper/020:25:140
926296992120,1cyclictest0-21swapper/021:35:130
926296992120,1cyclictest0-21swapper/019:25:130
926296992119,1cyclictest0-21swapper/022:45:120
92629699210,21cyclictest1113391-21apt-get00:25:140
92629699210,21cyclictest0-21swapper/020:50:120
92629699210,21cyclictest0-21swapper/000:30:200
92629699210,20cyclictest0-21swapper/019:30:110
92629699210,20cyclictest0-21swapper/019:20:200
92629699210,1cyclictest999553-21ntpq21:10:170
92629699210,0cyclictest0-21swapper/020:10:130
92629699210,0cyclictest0-21swapper/020:05:130
926314992020,0cyclictest0-21swapper/722:35:137
926314992020,0cyclictest0-21swapper/722:30:137
926314992020,0cyclictest0-21swapper/722:25:127
926314992020,0cyclictest0-21swapper/722:10:117
926314992020,0cyclictest0-21swapper/722:05:177
926314992020,0cyclictest0-21swapper/721:25:127
926314992020,0cyclictest0-21swapper/700:35:117
926314992019,1cyclictest0-21swapper/723:55:027
926314992019,1cyclictest0-21swapper/722:55:007
92631499200,0cyclictest0-21swapper/721:05:137
92631499200,0cyclictest0-21swapper/720:30:137
926312992020,0cyclictest0-21swapper/600:35:126
926312992020,0cyclictest0-21swapper/600:00:116
926312992019,1cyclictest1068648-21apt23:10:006
926312992019,1cyclictest0-21swapper/620:20:126
926312992018,2cyclictest1012544-21sh21:35:006
92631299200,0cyclictest0-21swapper/623:20:206
92631199203,4cyclictest0-21swapper/519:45:045
92631199203,14cyclictest0-21swapper/521:45:535
92631199203,14cyclictest0-21swapper/519:56:035
926311992020,0cyclictest0-21swapper/523:20:125
926311992020,0cyclictest0-21swapper/522:40:125
926311992020,0cyclictest0-21swapper/522:35:135
926311992020,0cyclictest0-21swapper/522:30:025
926311992020,0cyclictest0-21swapper/500:35:125
926311992020,0cyclictest0-21swapper/500:20:115
926311992020,0cyclictest0-21swapper/500:05:155
926311992020,0cyclictest0-21swapper/500:05:145
926311992019,1cyclictest1063199-21apt-get23:00:135
926311992019,1cyclictest0-21swapper/519:45:005
92631199200,20cyclictest0-21swapper/523:10:185
92631199200,0cyclictest0-21swapper/523:45:125
926307992020,0cyclictest0-21swapper/423:55:114
926307992020,0cyclictest0-21swapper/423:45:124
926307992020,0cyclictest0-21swapper/423:10:114
926307992020,0cyclictest0-21swapper/422:40:124
926307992020,0cyclictest0-21swapper/421:00:124
926307992020,0cyclictest0-21swapper/420:40:114
926307992020,0cyclictest0-21swapper/419:15:124
926307992019,1cyclictest1083464-21appstreamcli23:35:034
92630799200,0cyclictest0-21swapper/421:05:184
92630799200,0cyclictest0-21swapper/420:20:124
926306992020,0cyclictest0-21swapper/320:00:183
926306992020,0cyclictest0-21swapper/319:50:133
926306992020,0cyclictest0-21swapper/319:30:113
926306992020,0cyclictest0-21swapper/319:25:033
926306992020,0cyclictest0-21swapper/319:10:183
926306992019,1cyclictest0-21swapper/321:55:103
926306992019,1cyclictest0-21swapper/319:20:123
926306992018,1cyclictest0-21swapper/323:10:183
92630699200,20cyclictest0-21swapper/319:35:133
92630699200,0cyclictest0-21swapper/323:15:113
926301992020,0cyclictest0-21swapper/223:35:032
926301992020,0cyclictest0-21swapper/223:20:122
926301992020,0cyclictest0-21swapper/221:30:122
926301992020,0cyclictest0-21swapper/220:40:102
926301992020,0cyclictest0-21swapper/220:20:122
926301992020,0cyclictest0-21swapper/219:45:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional